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1.  Introduction  and  Summary 

Readiness  evaluation  is  one  of  the  most  important  problem  areas  in 
the  study  of  complex  military  systems.  Such  studies  usually  encompass  a 
large  number  of  measurements  on  the  performance  of  the  various  subsystems 
and  then  attempt  to  construct  reasonable  models  that  relate  the  evaluation 
indices  of  the  subsystems  in  a meaningful  functional  manner.  This  is 
indeed  very  often  a formidable  task  due  to  the  complexity  and  multiplicity 
of  variables  and  functions.  However,  it  is  often  the  case  that  many  of  the 
measured  variables  correlate  with  each  other.  These  intercorrelations 
reveal  that  variables  contain  some  information  on  each  other.  Accordingly, 
if  these  intercorrelations  can  be  utilized  in  a manner  that  allows  con- 
siderable reduction  in  the  number  of  factors  to  be  considered,  without  much 
loss  in  the  information  in  the  original  data,  a significant  step  can  be 
taken  towards  simplification  of  the  problem.  The  present  paper  applies 
several  well-known  multivariate  statistical  methods  to  attain  this  goal. 

The  main  objective  of  the  present  paper  is  to  discuss  what  some  of  the 
available  multivariate  statistical  methods  can  attain  and  to  show  that  such 
methods  can  be  easily  implemented  by  utilizing  appropriate  computer 
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packages.  In  particular,  we  discuss  the  methods  of  principal  and  rotated 
factor  analysis , and  discriminant  analysis.  We  apply  these  methods  to 
simulated  data  on  21  operational  readiness  variables  related  to  Navy  des- 
troyers. The  variables  and  the  corresponding  parameters  were  taken  from 
the  Institute  of  Naval  Studies  study  [5].  This  study  analyzes  actual  data 
collected  over  several  years  on  83  destroyers.  It  extends  to  various 
aspects  of  the  readiness  problem  and  relates  operational  readiness  to  mate- 
rial readiness.  As  mentioned  in  our  recent  survey  paper  [3],  we  believe 
that  study  [5]  is  of  fundamental  importance.  It  employs  a variety  of  multi- 
variate statistical  procedures  in  a penetrating  manner  and  provides  a sound 
analysis  of  complicated  problems.  Our  intention  is  not  to  duplicate  that 
study  but  to  provide  an  exposition  on  the  application  of  the  multivariate 
methods  mentioned  above.  We  have  chosen  to  create  data  sets  by  simulation 
and  not  to  use  actual  data  since  in  this  way  we  can  generate  data  following 
multivariate  normal  distributions  having  specific  structures.  Thus,  by 
applying  the  multivariate  methods  on  different  sets  of  simulated  data  we 
can  illustrate  the  strength  of  the  methods  and  what  can  actually  be  achieved. 
We  will  show  that  the  systems  (destroyers)  in  this  example  can  be  classified 
according  to  the  values  of  two  or  three  factor  scores,  which  relate  all  21 
variables  in  an  orthogonal  fashion.  The  factor  scores  can  be  graphed  and 
their  periodic  determination  can  provide  important  follow-up  on  the  state 
of  readiness.  Statistical  control  charts  can  be  devised  to  provide  early 
detection  of  deterioration  in  the  state  of  readiness.  Similarly,  if  the 
data  consists  of  a mixture  of  two  or  more  samples  from  different  multivariate 
populations,  the  plotting  of  factor  scores  obtained  by  a factor-analysis 
of  the  whole  data  set  can  reveal  the  existence  of  different  clusters.  These 
ideas  will  be  demonstrated  in  the  present  paper.  We  start  in  Section  2 with 
a description  of  the  simulations  and  the  structure  of  the  data  sets.  Sec- 
tion 3 is  devoted  to  principal  and  rotated  factor  analysis.  In  Section  4 
we  discuss  the  application  of  factor  analysis  to  detecting  changes  in  the 
state  of  readiness  of  systems.  Here  we  also  compare  discrimination  and 
classification  based  on  the  factor  scores  to  those  obtained  by  step-wise 
discriminant  analysis.  The  mathematical  development  is  presented  in 
appendices.  We  also  provide  some  computer  programs. 
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2 . Simulating  Data  Sets 

In  the  present  study  we  construct  data  sets  on  the  basis  of  the 
operational  readiness  indices,  ORI,  of  the  following  21  variables. 


V1 

Ship  control 

SHC 

V2 

Navigation 

NAV 

V3 

Surface  operations  - CIC 

(Combat  Information  Center) 

SOPS 

v4 

Battle  communications 

BATC 

v5 

Surface  gunnery  (non-firing) 

SGUN 

v6 

AAW  (Anti-air  Warfare)  - CIC 

AAWC 

v7 

AAW  - Weapons  control 

AAWN 

V8 

Engineering 

ENG 

v9 

Setting  material  condition 

SMC 

V10 

Damage  control 

DC 

T — 1 
I — 1 
> 

NBC  (Nuclear,  biological,  and  chemical) 

NBC 

V12 

Low-visibility  piloting 

LVP 

V13 

CIC  - Assistance  in  piloting 

CICAP 

•<r 

i— i 
> 

CIC  - Assistance  in  ASW 
(Anti-submarine  warfare) 

CICASW 

V15 

ECM  (Electronic  countermeasures) 

ECM 

V16 

Modified  full-power  run 

BFPR 

i r- 
I !— H 

> 

Surface  firing 

SFIR 

cc 

> 

AA  firing 

AAF 

V19 

Gunfire  support 

GUNS 

v20 

Communicat ions 

COMM 

V21 

ASW  operations 

ASW 

The  raw  scores  obtained  on  these  variables  by  the  83  ships  during 
training  can  be  obtained  in  the  Institute  of  Naval  Studies  [5].  We  consider 
rather  the  ORT  1 s which  are  indices  obtained  from  the  raw  scores  by  the 
transformation 


ORI  =5+2  (NSCORE) 


(2.1) 
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where  NSCORE  denotes  the  standard  normal  fractile  corresponding  to  the 

percentile  point  of  the  raw  score.  More  precisely,  if  x/1N<...<x/N 

Cl)  = = in) 

is  the  order  statistic  of  a sample  of  n observations  on  a variable  x , 

the  NSCORE  corresponding  to  x,.N  is  z,.x  = $ l“7Ti  5 i = l,...,n  ; 

(1)  (1)  \n+l/ 

where  4>(z)  is  the  standard  normal  C.D.F.  Theoretically  the  ORI  values, 
of  each  of  the  variables  v_^  (i=l , . . . , 21)  , are  normally  distributed 

with  mean  E{v_^}  = 5 (i=l,...21)  and  variance  Var{v_^}  = 4 (i=l,...21). 

In  addition,  the  ORI  variables,  v_^  , are  not  independent.  We  assume 

T 

that  the  vector  v = [v- , . . . ,v^ ] has  a multinormal  distribution 
% 1 21 

T 

NQi,^)  , with  mean  vector  w^ere  ^ “ [1, •••,!]  , and  covariance 


re  denotes  the  matrix  of  intercorrelations  among 

the  21  variables  v_^  . For  the  purpose  of  simulating  data  sets  we  have 

used  the  matrix  given  in  the  Institute  of  Naval  Studies  [5]  and  pre- 
sented here  in  Table  1.  The  simulation  was  performed  according  to  an 
algorithm  described  in  Appendix  I.  It  is  based  on  simulating  independent 
standard  normal  variates,  z , and  transforming  them  to  corresponding  v_^ 

variates  (i=l, . . . , 21)  by  employing  recursive  relations  between  joint  and 
conditional  multinormal  distributions.  A Fortran  program  for  such  simulation 
is  given  in  Appendix  IV.  In  Table  2 we  present  a sample  of  n = 50  vectors 
of  six  variables  (v^,  v,_ , v^,  v^,  v^^  v-^)  simulated  according  to  this  pro- 
gram. The  sample  means,  standard  deviations  and  intercorrelations  are  pro- 
vided in  Table  3.  As  illustrated,  the  sample  statistics  are  generally 
deviating  to  some  extent  (according  to  their  sampling  distributions)  from 
the  parameters  used.  However,  in  actual  cases  the  population  parameters 
are  unknown  and  the  analysis  must  be  based  exclusively  on  the  sample  values, 
with  the  possible  incorporation  of  some  prior  information,  and  this  is  what 
we  are  doing  here. 
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INTERCORRELATIONS  BETWEEN 
ORI  VARIABLES  v to  v 


1. 

17 

0. 

C.  i 

0. 

04 

0. 

33 

0. 

31 

Ij. 

45 

0. 

1 0 

Ij  . 

06 

ij. 

i j 3 

1 . 

0. 

Jo 

0. 

IJ  o 

Ij. 

17 

Ij. 

13 

0. 

07 

0. 

12 

Ij  . 

03 

0. 

01 

ij . 

1 0 
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i j . 

22 

0. 

03 

Ij. 

13 

Ij. 

03 

0. 

14 

0. 
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0. 

01 

ij . 

£0 

1. 

12 

0. 

14 

0 . 
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01 

Ij. 

07 
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02 

Ij . 

09 

Ij. 

09 
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03 

0 . 

13 

! . 
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1 . 

0 0 

Ij. 

03 

Ij  . 

18 

Ij. 

03 

ij . 

14 

Ij . 

lL  C. 

0. 

01 

0. 

2 0 

1. 

12 

Ij . 

14 

Ij. 

26 

0 . 

01 

0 . 

07 

0. 

02 

Ij. 

09 

0 . 

09 

Ij. 

0 3 

ij . 

13 

1. 

03 

Ij . 

09 

1 . 

ij  0 

Ij. 

C.  Z' 

Ij . 

lL  ‘Z> 

ij . 

13 

Ij . 

1 1 

0. 

13 

Ij. 

10 

i . 

12 

Ij. 

35 

0. 

03 

o . 

19 

Ij. 

dO 

ij . 

03 

Ij . 

1 0 

0 . 

03 

Ij . 

04 

0. 

ij  6' 

J. 

18 

1 j . 

d.  -Z* 

Ij. 

lLO 

1 . 
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34 
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05 
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08 
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04 

0 . 
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03 
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04 
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0. 

20 

0. 

03 
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13 

0. 

02 

j . 
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0. 
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34 

Ij . 

c.  r 
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ij . 
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0. 
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Ij . 
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Ij . 
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0. 

03 
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j. 
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0. 
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Ij . 
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j. 
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, 04 

Ij. 

12 

0, 

. 17 

1, 

. 0 0 

0, 

. 03 

0, 

. 1 3 

Ij, 

. 03 

Ij. 

02 

Ij, 

. 1 0 

0, 

. 03 

0. 

, ij  y 

0. 

18 

Ij, 

. 13 

0, 

. 13 

Ij 

. 05 

Ij 

. 05 

Ij. 

, 51 

Ij, 

. 13 

Ij 

. C.  -Z* 

0. 

12 

Ij. 

, 03 

o 

. 03 

o 

. 09 

1, 

. 0 0 

5 


oj  ro  ro  ro  ro  ro  ro  ro  ro  ru  ro 


T-385 


i 


TABLE  2 

50  SIMULATED  VECTORS  OF  SIX  VARIABLES 
ACCORDING  TO  THE  MULTINORMAL  DISTRIBUTION  N(5^.,4jy 


1 

Vi 

vr 

v _ 

V 

V 

1 

5 

6 

7 

12 

14 

1 

3.5  03 

3.369 

7.' 591 

7.  124 

3.463 

5.613 

c 

4.529 

5.294 

1 • 966 

5.417 

4.021 

6 . 6-03 

o 

5.594 

5 . 933 

0.347 

5.340 

6.  141 

4.522 

4 

1 . 391 

iz! . 948 

7.  371 

5 . 3 03 

5 . 933 

5.  051 

*r* 

j 

S . 68 1 

1 . 1 05 

8 • b56 

1 . 402 

4.  073 

4.  125 

A 

6 . 337 

4.293 

5 . y y 6 

6.643 

6.9  02 

7.504 

7 

4. 963 

6 ■ c!  6 1 

4 . 629 

5.431 

5.935 

2.434 

•-* 

2.956 

2.  443 

1.450 

1.7  62 

3.  117 

5.06  0 

9 

y . u o 7 

3 . 533 

4.  034 

4.1 36 

4 . 8 0 0 

4.747 

10 

y . 961 

3.451 

3 . 985 

3.774 

1.771 

3.  134 

11 

5.949 

7 . 3 07 

3.  955 

6 . 3 6 c 

•-»  -7 

l 

6.343 

12 

4 . 933 

4. 90S 

3.  4 09 

7 . 55  0 

4. 7 02 

6 . 352 

13 

4.244 

4.234 

2.731 

4 . 3 6 7 

5.351 

4 . 362 

14 

3.373 

3 . 3 6 0 

1 . 704 

4 . 3 4 9 

4.34  0 

6 . 0 03 

15  ■ 

5.  455 

dm  531 

9.  759 

4.765 

4. 340 

5.939 

16 

6 . 07  6 

6 ■ 3 3 3 

6 . 97  £ 

£ . 7 0 0 

5. 236 

7 . 398 

17 

2.43  0 

6 . 347 

7 . 09  0 

1 . 432 

3 . 63  9 

-.140 

13 

4.616 

3.535 

5.253 

7.  105 

5.44  0 

3.  175 

19 

3.397 

4.231 

3 . 646 

5.297 

5.  004 

7.421 

2 0 

7.915 

5 . 7 03 

6.  139 

3.344 

6.734 

10. 153 

21 

4.339 

4.453 

0.  926 

2.260 

3.  118 

5.672 

Cl! 

9 . 427 

6 . 974 

9.  020 

7.265 

7 . 532 

4 . 959 

23 

6.  122 

5.779 

5.  043 

6.474 

5 . 4 05 

8.  099 

24 

7.  042 

6.516 

2 . 366 

7 . 566 

3.579 

6 • 9 y 0 

25 

4.372 

6.  073 

9.  149 

5.884 

d m 1*  { J 

4.261 

26 

5.922 

5.  126 

4.  973 

5 . 062 

3.671 

3.633 

c r 

2 ■ 336 

3.512 

5. 6 07 

0.  032 

3.345 

1.516 

lZ.  C* 

4 . 626 

3 . 3 0 6 

2.  232 

4.252 

7. 336 

6.  028 

£9 

4.  0 07 

3.  133 

5 . 365 

1.313 

4. 890 

1.473 

3 0 

6* . 5 6 6 

7.713 

« . 269 

7 . 356 

6 . 933 

3. 450 

31 

5.  273 

3.930 

5.  021 

i — . O iZ.  J 

2.912 

2.715 

■J  o 

L_ 

3.  079 

4 . 357 

3 . 93  0 

5 . 727 

3.746 

7 . 437 

O 

4.797 

3.643 

5.  791 

5.551 

9.  067 

2 . 724 

34 

1 . 537 

- . 3 07 

3.601 

3 . 556 

5.196 

2.714 

“IT 

. "i 

1 . 722 

2.332 

3.334 

1 . 992 

1.319 

U .916 

3d 

2.967 

3.397 

1 . 633 

1.  195 

5.  045 

2.523 

j 1** 

4.441 

3.769 

6 . 1 53 

1 . 23  0 

6 . 165 

4.472 

yy 

• 5.537 

5.391 

5.  139 

3.330 

0 . 53  0 

6.516 

39 

2.534 

4.352 

5.634 

3 . 57 6 

5.  014 

1 . 543 

40 

5.  141 

5.  169 

2.510 

2.349 

4.  054 

4 . 894 

41 

5. 726 

2 . 64  0 

6.  141 

1 0.725 

3.585 

11.300 

42 

4 . 643 

5.437 

5.  33  0 

6.518 

5.  053 

7 . 469 

43 

7.  123 

3.347 

3 . 67 4 

3.455 

5.530 

4.  176 

44 

5.  103 

7.733 

2.357 

3.357 

4.1 93 

2.873 

45 

6 . 176 

5.253 

5.  429 

6.230 

6.4  03 

3.  543 

46 

0.  6 06 

1 . 079 

5.370 

3.985 

2.871 

2.396 

47 

7.  174 

4 . 692 

3.  537 

6.435 

4.326 

9 . 336 

43 

0.549 

6 . 349 

5.  689 

3.537 

6.54  0 

L_  • Jl  J 

49 

3.  342 

1 . 917 

5.  073 

4. 799 

2.  103 

6 . 32 1 

50 

5.23  0 

6 . 934 

1 . 036 

7.321 

6.9  04 

5.  135 
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TABLE  3 

SAHPLE  STATISTICS  OF 
THE  SIX  VARIABLES  IN  TABLE  2 


SAMPLE  MEANS  AND  STAND.  DEV. 


T 

V5 

v6 

V7 

v12 

v14 

luiANS  4.360 

4.577 

4.644 

*4 . r*  c'  c* 

4 . 993 

4.914 

ST.  DEVS . 1.993 

1 . 397 

2.  180 

2.244 

1.916 

2.  468 

CORRELATIONS 

MATRIX 

V1 

V5 

v6 

V7 

V12 

v14 

V1  1 . 0 0 0 0 fl  ft 

5 U . 585  8 r 7 

0 . 535877 

0. 133915 

0 . 553 1 62 

o . 

399  037 

o . 

519431 

1 . 0 0 0 0 0 0 

0. 158194 

0. 362251 

0 . 

233443 

0 . 

1 d 8 u 7 6 

V0  0.  133915 

0. 158194 

1 . 0 0 0 0 0 0 

0. 237437 

0 . 

192637 

— . 

023431 

V7  0.558162 

0.362251 

U .28  7 4 8 ■'* 

i . o n o n n n 

0 . 

492125 

o . 

617677 

V12  0.399  037 

V14  0.519481 

0. 233443 

U. 198687 

0. 492125 

1. 

0 0 0 0 0 0 

0 . 

£39943 

0.  123  076 

-. 023431 

U . 6 1 7677 

0 . 

239943 

1. 

0 0 0 0 0 0 

It  should  also  be  remarked  that  the  simulation  is  based  on  the  matrix 
of  intercorrelations  of  the  above  six  variables  only.  This  matrix  is,  how- 
ever,  a submatrix  of  that  given  in  Table  1 and  can  be  obtained  by  reading 
the  appropriate  rows  and  columns.  In  the  course  of  the  present  study  several 
different  data  sets  were  simulated,  employing  the  same  algorithm  with  only 
slight  modifications  from  case  to  case,  as  will  be  explained  later. 

3 . Principal  and  Rotated  Factor  Analysis 

It  is  generally  difficult  to  make  comprehensive  inference  of  multivariate 
data  without  further  analysis,  due  to  the  large  number  of  intercorrelated 
variables.  Even  in  the  case  of  only  six  variables  it  will  be  difficult  to 
discriminate  between  "good1'  and  "bad"  systems,  just  by  inspecting  the  data 
sets,  or  by  performing  a univariate  analysis  on  each  variable  separately. 

The  methods  of  multivariate  analysis  are  designed  to  provide  the  needed 
information  in  cases  of  many  variables  which  are  highly  correlated.  In  the 
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present  section  we  discuss  the  methods  of  principal  and  rotated  factor 
analysis,  and  show  how  they  can  be  applied  to  the  evaluation  of  the  readi- 
ness of  systems.  An  outline  of  the  theory  is  given  in  Appendix  II.  We 
refer  the  reader  for  an  extensive  development  of  the  theory  and  computer 
programs  to  the  books  of  Overall  and  Klett  [6],  Cooley  and  Lohnes  [4], 
Tatsuoka  [8],  and  Van  de  Geer  [9]. 


3.1  Principal  Factor  Analysis 


The  main  objective  of  principal  factor  analysis  is  to  provide  a 
small  number,  m , of  linear  combinations  of  the  original  variables 
Vl’*",Vp  (2_5m<P)  so  that  (i)  a large  proportion  of  the  total  variance  of 

the  original  variables  should  be  accounted  for  by  the  m transformed  vari- 
ables, and  (ii)  the  transformed  variables  should  be  uncorrelated.  It  is  shown 
in  Appendix  II  that  the  solution  of  this  problem  is  obtained  by  determining 

first  Lhe  m largest  eigenvalues  of  £ and  the  corresponding  eigenvectors; 
followed  by  determination  of  factor  scores  for  each  system.  Let 
A > . . . > X >0  be  the  eigenvalues  of  the  p x p correlation  matrix  R . 

1 ~ “ p 

Since  £ is  positive  definite,  these  eigenvalues  are  all  real  and  positive 
(with  probability  one).  Moreover  ^+"***^p  ~ P • Hence,  choose  m so  that 

(^1+* * *+X  ) /p  is  "close  enough"  to  1.  This  ratio  is  the  proportion  of  the 

sum  of  variances  of  v^i-1,  — ,p)  that  is  accounted  for  (explained)  by  the 


in  factors.  These  factors  are  constructed  in  the  following  manner.  Let 
^>(j)  (j=l,...,m)  be  the  orthonormal  eigenvector  of  ^ corresponding  to 

Aj (j=l, . . . ,m)  . The  m factor-score  variables  corresponding  to 
T 

^ = [v1# . . . ,v  ] are  given  by 


f . 
J 


u 

% 


j 1 , • . * , m (3.1) 


where  ^ = [u^,...,u^]  is  a vector  of  standard  scores  corresponding 
to  ^ , i.e.,  u^  = ^vi~Vi^si  9 ^ ~ 1>***>P  > denotes  the  sample 
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mean  of  the  ith  variable  and  s_^  designates  its  sample  standard  deviation. 

The  m factor-scores  are  computed  for  each  unit  in  the  sample.  The 
sample  factor-scores  are  uncorrelated  standard  scores.  The  coefficients 
b_.  in  (3.1)  (i=l,...,p)  are  sometimes  interpretable  in  terms  of  the 

original  ORI  variables.  We  illustrate  these  ideas  first  on  the  p = 6 ORI 
scores  of  the  sample  of  50  units  given  in  Table  2.  (Further  analysis  of  all 
21  ORI  variables  appears  below.)  The  numerical  results  presented  were 
obtained  by  Program  SINU,  presented  in  Appendix  IV.  The  eigenvalues  and 
eigenvectors  of  the  correlation  matrix  presented  in  Table  3 are  given  in 
Table  4.  These  values  were  computed  by  employing  a computer  library  sub- 
routine which  determines  the  eigenvalues  and  eigenvectors  of  a symmetric 
matrix.  This  subroutine  program  was  merged  into  Program  SIMU. 


TABLE  4 

EIGENVALUES  AND  EIGENVECTORS  OF 
THE  CORRELATION  MATRIX  IN  TABLE  3 


EIGENVALUES  Ur  COPPER.  MATRIX 

^5  h ^2  ^6  V 

U . 33432 1 0 . 353 0 06  1 . 063542  0 . 239473  0 . 7 0 0426 


IIGEMVECTDRS 


1 

743232 


^(5) 

^(3) 

£(2) 

£(6) 

^(4) 

^(1) 

0 . 707693 

U . 26672  0 

035902 

0. 399522 

-.11 5332 

0 . 5 0363 

- . 329692 

U . 7 49462 

0 . 292523 

-.336753 

U . U 2 6 6 6 1 

0. 36045 

ij . u 7 2 6 U 5 

-.410353 

0. 755713 

156339 

-. 440037 

U . 1 9236 

-.  603214 

-.220703 

1 13193 

0. 546450 

— • U c*  7 5 9 U 

0.514  02: 

0. 117372 

— . 321752 

0. 141 073 

-.231162 

0 . 3 1 2732 

U . 33573: 

ij  „ ij  ! -i 3 6 6 9 

-.215730 

555123 

-. 591394 

— . 356564 

0.  4 0732: 

- 9 - 
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If  we  consider  m-3  factor-scores  in  Table  4,  we  see  that  the 

proportion  of  explained  variability  is  ^(X^+A^A  ) " • 78  . (In  other  words, 

three  factor-scores  out  of  six  explain  close  to  80%  of  the  correlation 
matrix  .)  Notice  that  the  first  factor-score,  f , weights  positively 

each  one  of  the  six  ORI  variables,  v5,  v&,  v7>  v12,  v.^  . However, 

variables  v^  and  Vy  obtain  weights  which  are  about  1.22  times  larger 
than  those  of  v^ , v^2  and  v^  and  about  2.6  times  larger  than  that  of  v^  . 
In  terms  of  the  ship  functions,  factor  f emphasizes  Ship  control  and 
AAW-Weapons  control  considerably  more  than  AAW-CIC  or  Low-visibility 
piloting,  etc.  The  second  factor-score,  f2  , emphasizes  Vg  (AAW-CIC) 

and  gives  a large  negative  weight  to  v^  . The  third  factor-score  emphasizes 
v5  (Surface  gunnery)  and  deemphasizes  v&,  Vy,  v12,  . Thus,  the  three 

dimensions  of  this  factor  analysis  are:  "Ship  and  AAW  control,"  "Radar  and 
information  communication"  and  "Surface  gunnery."  In  Table  5 we  provide  the 
three  factor— scores  of  the  50  units  in  the  sample.  Figure  1 presents  a 
scattergram  of  f2  versus  f^  . By  indicating  on  the  scattergram  the  unit 
number  of  each  point  we  can  immediately  discriminate  between  systems  having 
high  factor— scores  on  the  two  dimensions  (like  30,22,2)  and  those  having  low 
factor-scores  on  both  dimensions  (like  8).  Furthermore,  by  indicating  the 
zero  lines  (solid)  and  the  lines  at  +1  (broken)  we  can  obtain  further 
information  on  the  state  of  readiness  of  the  systems  in  the  sample.  For 
example,  systems  47  and  41  have  high  scores  on  f but  are  in  the  lower  tail 
of  f2  . This  means  that  their  control  functions  are  "good"  but  the  CIC 

functions  are  "bad."  Similarly,  systems  27  and  17  are  low  on  f but  high 

on  f . Although  this  information  is  given  also  in  Table  2,  it  is  often 

confounded  and  obscured.  A scattergram  of  the  factor-scores  provides  a 
convenient  expression  of  the  relative  state  of  readiness  of  the  systems. 

Suppose  now  that  the  sample  of  50  systems  consists  of  two  subsamples 
from  two  different  multinormal  populations.  What  will  the  factor  scores 
reveal?  To  illustrate  numerically  the  result  of  principal  factor  analysis 
on  such  a mixture  of  samples  we  simulated  a data  set  in  which  the  first  25 
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TABLE  5 


FACTOR-SCORES 

OF  DATA  IN 

TABLE  2 

CTG 

R SCORES 

f 

f 

f 

1 

2 

3 

1 

1 . 3566 

1 - 4437 

0 . 5523 

iz 

0. 035 0 

-1  - 3533 

0.7455 

■“i 

0. 2493 

-.9433 

1.21 97 

4 

-.2353 

IJ  ■ r Z‘  1 

- 1 . 9226 

5 

-1.4342 

-.3711 

— . 737 6 

o 

1 . 09 0 4 

-. 1313 

-. 3329 

l' 

0.  1347 

0 . 3 036 

0.7144 

3 

-1.3267 

- 1 . 37  06 

0 . 1 073 

9 

0. 2 075 

-.3450 

0. 2330 

1 0 

-. 3364 

~. 1731 

U . i 2 i*' 

1 1 

0.7315 

-.2433 

1.5631 

12 

0 . 5335 

-.3534 

0136 

13 

. 22  ( 1 

-.4536 

0. 0936 

14 

- . 4693 

-1.41 49 

0073 

15 

0. 1561 

1 . 1 233 

-1.3  033 

1 6 

0.5643 

IJ  ■ o i**  r 1 

0. 6035 

17 

-1 . 1530 

2 . 2 9 5 3 

0.9743 

13 

0. 0307 

0.3435 

-.7513 

13 

0. 0963 

-. 9362 

-.3611 

2 0 

1 . 9733 

~. 5931 

-.6333 

21 

-. 7345 

-1 . 4294 

1. 1530 

c.  c. 

1 . 3651 

1 . 7375 

0. 0577 

23 

0 . 9594 

— . 4617 

0.  053  0 

24 

0. 3356 

-1 . 0400 

1.2631 

c 

C. 

0 . 2335 

1 . 6594 

0. 0677 

26 

0. 0046 

0 . 3 3 0 0 

0. 6407 

37 

- 1 . 559  3 

1 . 0576 

0. 1709 

33 

0. 0335 

— . 3679 

-. 3610 

3 9 

-1 . 0137 

0.3316 

-.2311 

*3  0 

1.34 03 

1 . 9553 

0. 2934 

31 

-.7254 

0.4435 

0. 4945 

7*  'j 

1.3312 

- . 5633 

-.3064 

■“<  n 

0 . 3345 

0.3712 

— 1 . 26 IJ2 

34 

-1.5269 

- . 5433 

-2 . 2614 

c* 

■(  _l 

-2. 0267 

0. 0275 

0.  1903 

!-»C« 

-1.2431 

- . 353  0 

0. 6296 

07 

-. 4610 

0.7503 

-.5110 

— . 3461 

— • 3224 

1 . 1453 

39 

-.3113 

1.1315 

— . 1332 

4 Li 

— . 37 3 6 

- - 5333 

1 . 0934 

41 

1 . 34 0 1 

-1  - 3501 

-2.9433 

42 

U . 6 4 7 0 

0330 

- . 3354 

43 

0. 0315 

. 2 U ■33  f 

0.3112 

44 

1 1 05 

0 . 3 046 

2 . 1961 

45 

0 - 56 1 8 

U . 6 6 2 2 

0. 0322 

46 

— 1 . 6 2 0 4 

0. 2301 

-1 . 5515 

47 

0 - 36 1 3 

-1.6213 

0.  0733 

43 

-.6117 

1 . 33 02 

-. 0064 

43 

— . r,n4  1.1 

-.3513 

-1. 1043 

3 Q 

0. 7599 

9025 

1 . 1730 
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Figure  1.  Scattergram  of  the  Factor-Scores 

Versus  for  the  Data  of  Table  5. 


vectors  are  identical  with  the  first  25  lines  of  Table  2 (N(5^,4R))  and 

the  last  25  vectors  are  simulated  from  NQ.,4R)  . The  sample  means, 
standard  deviations,  correlation  matrix,  eigenvalues  and  eigenvectors  of 
these  50  vectors  are  given  in  Table  6.  The  corresponding  three  factor- 
scores  are  given  in  Table  7.  We  see  in  Table  6 that  in  such  a mixture  the 
correlations  become  larger  and  so  is  the  maximal  eigenvalue.  The  three 
factor-scores  account  here  for  90%  of  the  variability  reflected  in  R . 

In  Figure  2 we  provide  a scattergram  of  f^  versus  f^  . The  points 
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TABLE  6 

SAMP LE  STATISTICS  OF  A SAMPLE  OF  50  UNITS 

CONSISTING  OF  25  UNITS  FROM  N(51,4R)  AND 

25  UNITS  FROM  »(1 ,4R)  % 

% y %' 


SAMPLE  ME  ft  MS  AMD  STAND.  HE 


MEANS 
ST.  DEVS. 


V1 

l!  . O 6 U 
3.  1 07 


* i 


3 . 0 1 3 


Vo 

2.644 
3.  030 


v_ 


Ed  9 


v 


12 


v 


14 

£.914 

3.519 


L-ORREL  AT  I □MS-  MftTR  I X 


0 0 0 0 0 0 
•3 1 1 33  0 
62 1 0 1 2 
304749 
736423 
730947 


0. 311330 
1 . 0 0 0 0 0 0 
0 . 6 1 44 1 9 
0 . { d -3  r'  3 4 
U . 667 3 5 9 
0.61 1753 


0. 621012 
0 .614419 
1 . 0 0 0 0 0 0 
0. 623304 
0. 592933 
0. 490936 


304749 
r 2 3 r’  3 4 
623304 
0 0 0 0 0 0 
i‘  o o'  o 2 
317156 


0, 

0. 

0. 

0. 

1. 

0. 


6 6 7 3 5 9 
592935 
763023 
0 0 0 0 0 0 
642159 


0 . 73  0947 
0 .511 753 
0 . 43  0936 
0 .3171 56 
0. 642153 
1 . 0 0 0 0 0 0 


: I bEM VALUES  OF  CORREL.  MATRIX 

A. 


A. 


A, 


U • 167197 


2 1 bcN V E C TORS 


0 . 363 039  0 . 55  0369  4 . 4557  04  0 . 336945  0 .121 246 


^(5) 


0. 61 0051 

— - 223232 
0. 030316 

— ■ 6 y y y 3 6 

0. 159404 

0. 155249 


fc(3) 

2 7 6 y £ 0 
7 64794 
39 0337 
327609 
147009 
335033 


fe(2) 


k(l) 


^(4)  fe(6) 


-. 113073 
u .15 y 7 6 5 
U . 796742 
194375 
ij  a ij  ij  7 5 6 6 
~ . joo4.j5 


j.  433211  - 

j.  406333  - 

. 3 5 6 3 0 — 

0.436357  - 

).  4 04763  0 

).  40  0310 


141313 

IJ  y IJ  1 J rn 
2 r*  U »**  9 1'* 
0 049 06 
366399 
333467 


-.5701 14 
0. 364232 
U > U r 1749 
-4  y i j 6*  u 2 
0. 193340 
U . 513236 
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TABLE  7 

FACTOR-SCORES  OF  50  SYSTEMS  IN  MIXED  SAMPLE 


ICTGR 

SCORES 

f 

f 

f 

1 

2 

3 

1 

1 . 3249 

0. 9302 

0 • i 4 1*'  2 

Cp 

0 . 633 1 

“1.1 033 

0. 5479 

1 J 

U « 7 6 9 9 

— 1 . 0667 

1 . 3573 

4 

0.7072 

1 . 1 1 i*‘  O 

— 1 . 3337 

5 

- . 0472 

“.2299 

-.7301 

6 

1 . -3266 

1723 

-.9027 

»*’ 

0 . 3453 

0.7399 

0. 9243 

i~i 

~. 0050 

- . 3 0 06 

— a Uiz  6 

9 

0 . 3 0 03 

1696 

0 . 243  0 

1 0 

0.  1936 

ij  . 3 3 6 6 

0.  1392 

11 

1 . 0399 

-.31 59 

1 . 3313 

12 

0 . 9697 

— » c*  6 U 7 

— . 1 956 

13 

0.5917 

-.3196 

0. 2196 

14 

0.4236 

— 1 . u 3 3 6 

-. 1133 

15 

0. 9535 

1.6044 

-1 . 9730 

1 6 

1.1 £69 

0. 7595 

0. 4347 

17 

0.2631 

2 . 5942 

1 . 1 327 

13 

0. 7391 

0.5113 

— . 633 0 

19 

0 . 73  04 

-.7011 

-. 5271 

£0 

1 . 7745 

-.7450 

-. 3639 

£1 

0.2509 

-1 . 0306 

0 . 97 63 

C.  C. 

1.7912 

1 . 4666 

0 . £ 062 

c o 

1.2417 

-.4463 

-. 1469 

£4 

1 . 1 033 

-1 . 0769 

0.9729 

25 

0.9771 

1 . 9196 

-. 1751 

£6 

-.7617 

0. 1372 

0. 6030 

£7 

-1 . 4390 

1 . 2432 

0. 2769 

■j  o 

L-  «_• 

— .7 433 

— 1 . 2636 

-. 1629 

29 

-1.2324 

0 . 95 1 6 

0. 0151 

30 

0. 0230 

1 . £930 

0.5041 

31 

-1 . 1250 

U a 4 1 2 

0. 4726 

3 £ 

-. 0333 

-1 . 1502 

-. 0931 

33 

-.5271 

0.5533 

-.7421 

34 

-1.5472 

. 2 2 1 3 

-2. 0362 

35 

-1.3205 

0.3797 

0 . 1 596 

36 

-1 . 4303 

-.4117 

0 . 354o 

37 

-. 9047 

U . 6336 

-.3415 

OQ 

-.9355 

— . 2245 

0. 6433 

-1.  1117 

1.0521 

0. 0347 

40 

-.9956 

— . 7 624 

1 . 0535 

41 

0.2710 

-1.7159 

-3. 0711 

42 

-.3301 

— . 3335 

-.5033 

43 

-.7755 

-.4413 

0. 4576 

44 

— . 3467 

-. 1133 

£.2624 

45 

-.4526 

0.2396 

0.2413 

46 

-1.5472 

0.6127 

-1.5592 

47 

-.3164 

-1.3532 

-.2355 

43 

-.9539 

1 . 1256 

0.2733 

49 

-1.0917 

-.5511 

— 1 . 4623 

50 

-.4574 

-1.5533 

1.3502 
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in  Figure  2 representing  systems  26-50  have  been  circled.  We  see  a very 
clear  separation  between  the  two  subsamples.  Although  this  example  may 
seem  somewhat  artificial  it  shows  that  principal  factor  analysis  may  reveal 
clustering  of  subsamples  in  case  the  populations  are  sufficiently  distinct. 
A discriminant  analysis  can  then  be  performed. 
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Figure  2.  Scattergram  of  f Versus  f^  in  Mixed  Sample. 


15  - 


T-385 


3. 2 Rotated  (Orthogonal)  Factor  Analysis 

In  the  present  section  we  consider  the  method  of  factor  analysis, 
when  the  number  of  variables  (21)  is  considerably  larger  than  the  number 
of  variables  (6)  in  the  examples  of  the  previous  section.  The  simulation 
is  based  on  Program  SN0R2,  which  simulates  (raw)  ORI  scores  and  writes  them 
directly  into  a data  file  "RSCORE"  in  the  computer.  The  sample  means, 
standard  deviations  are  written  into  a file  "SMNS"  and  the  intercorrelations 
are  written  into  a computer  file  "MATRIX".  The  files  "RSCORE"  and  "SMNS" 
are  then  read  into  a program  which  computes  the  standardized  variables 
z^  (i=l, . • . ,21)  . These  standardized  values  are  written  into  a computer 
data  file  "ZSCORE".  The  files  "MATRIX"  and  "ZSCORE"  can  then  be  used  to 
perform  a rotated  factor  analysis  by  one  of  the  computer  programs  which  may 
be  available  in  the  computer  library.  We  have  chosen  to  use  the  SPSS  [7] 
factor  analysis  program.  The  program  has  the  option  of  reading  the  correla- 
tion matrix,  rather  than  the  whole  data  set.  We  therefore  merged  the  file 
"MATRIX"  into  the  SPSS  program.  The  sample  means  and  standard  deviations 
of  the  sample  of  21  variables  simulated  according  to  N(5^,4R)  are  given 
in  Table  8.  The  matrix  R for  the  simulation  is  that  of  Table  1.  The 
sample  correlation  matrix  is  of  size  21  x 21  and  will  not  be  given  here. 


TABLE  8 

SAMPLE  MEANS  AND  STANDARD  DEVIATIONS  OF 
SIMULATED  SAMPLE  OF  50  VECTORS  OF  21  ORI  VARIABLES 


MEANS 


ST.  DEVS. 


4*75!.:;  5*277  4*913  5*450  4 * 897  4*753  4*39 1 

5 * 0 6 5 4 * 5 6 7 5 * 0 4 7 4 * 3 7 3 4 * 3 9 7 4 * ? 3 7 5 * 3 7 3 

4*664  4 * 952  4*463  4*941  4*697  5*012  5 >030 

2 * 023  2 * 323  2 * 1 33  1*  932  1 * 967  2 * 358  2 * 136 

2 * 0 9 9 1 * 7 5 2 2 •>  2 1 3 1 > 7 2 3 1 * 7 9 4 2 * 1 2 0 2 * 3 8 3 

1*918  2*177  1*515  2*263  1*759  2*043  2 >623 
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The  first  step  in  the  SPSS  program  is  to  compute  the  eigenvalues  and 
eigenvectors  of  the  correlation  matrix.  All  the  eigenvalues  are  given  in 
Table  9. 


TABLE  9 

EIGENVALUES  OF  THE  SAMPLE  CORRELATION  MATRIX 


FACTOR 

EIGENVALUE 

POT  OF  VAR 

CUM  POT 

:i 

4 < 71 7/4 

22  ♦ 5 

22 . 5 

'•) 

All 

3*04975 

1 4 , 5 

37  ♦ 0 

3 

2, 15763 

10:  3 

47  < 3 

4 

1 * 71341 

8 * 2 

55  ♦ 4 

S 

1 . 45501 

6 9 

62  ♦ A 

6 

1 • 22593 

5 , 8 

68  ♦ 2 

7 

1 ♦ 1 1568 

5 . 3 

T b:; 

8 

♦ 95484 

4 * 5 

78  ♦ 0 

9 

77374 

....  ~v 
•.*>  * / 

8 1 ♦ 7 

10 

v 6V 1 66 

3 ♦ 3 

85 . 0 

:t  :i. 

♦60214 

2 •>  9 

O Cl 

\ ) / ❖ / 

12 

♦ 52346 

2 ♦ 5 

90  ♦ 4 

13 

♦ 40730 

1 . 9 

92,3 

14 

♦32128 

1 ♦ 5 

9 3 <9 

15 

♦ 29829 

1 ♦ 4 

95,3 

16 

♦25938 

1 ♦ 2 

96,5 

1 7 

♦ 23882 

1 ♦ 1 

97,6 

18 

♦ 16924 

. 8 

98  ♦ 5 

19 

♦ 13962 

♦ 7 

99  ♦ 1 

20 

♦ 1 1 074 

♦ 5 

99,6 

i 

,07412 

♦ 4 

1 00  4 0 

The  eigenvectors  of  R are  given  in  a matrix  S of  size  p x m , called 
the  factor  (structure)  matrix.  The  m column  vectors  of  S are  defined 
as 


*(J) 


j = 1, . . . ,m  (3.2) 
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where 


is  the  eigenvector  corresponding  to  A^  , A^  > . . > A > 0 , 

i i 2 


the  m largest  eigenvalues  of  ^ . Obviously 


= Aj  . Further- 


J. 

more,  if  m = p then  ^ = Z is  the  spectral  decomposition. 


Let 


111  x % ^ 

«m  " A a"d 

Of 


It  is  desirable  to  choose  m so 


that  ^ is  negligible  (or  statistically  non-significant).  Tests  of  the 

% 

significance  of  ^ are  available  (see  Cooley  and  Lohnes  [4,103]. 
According  to  the  spectral  decomposition, 


m 


h = Z X.bj.  , 
i . J ij 
J=1 


i 1 , . . . ,p 


(3.3) 


is  the  part  of  the  ith  diagonal  element  of  £ (the  variance  of  z ) which 

is  explained  by  ^>.  The  parameter  h^  is  called  the  communality  of  the 

ith  variable.  In  Table  10  we  present  the  factor  (structure)  matrix  and  the 
communalities . 

The  factor-scores  defined  in  (31)  can  be  obtained  as  inner  products 
of  ^ with  the  column  vectors  of  £ = £ , where  A is  an  m x m 

diagonal  matrix  with  entries  A-,..., A . When  the  number  of  variables  is 

1 m 

large x it  is  generally  difficult  to  interpret  the  factor-scores  obtained 
by  the  matrix  ^ (see  Table  10) . For  this  reason  various  rotation 
techniques  were  developed,  which  transform  the  factor  (structure)  matrix 
£ to  a matrix  £ = , J?  being  an  m x m (orthogonal)  matrix  so  that 

the  column  vectors  of  fa  have  as  many  zero  entries  as  possible.  We  con- 
sider here  an  orthogonal  rotation  matrix  £ obtained  by  a method  called 
varimax.  This  method  maximizes  the  variance  of  the  coefficients  of  each 
column  vector  of  fa  (see  Van  de  Geer  [9,150]).  In  Table  11  we  present 
the  varimax  rotation  of  the  matrix  ^ of  Table  10,  as  obtained  by  the 
SPSS  program. 
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TABLE  10 

THE  FACTOR.  (STRUCTURE)  MATRIX  £ AND  COMMONALITIES 


. FACTOR  :l. 

FACTOR  2 

FACTOR  3 

COMMUNAL. TTY 

VI 

,63656 

-.38894 

- , 08892 

,56439  ... 

V2 

. 40868 

. 48347 

-.46057 

.61289 

V3 

.43219 

, 09805 

— , 3 6 0 0 o 

, 32604 

V4 

, 39535 

-.13877 

, 46957 

. 39606 

V 5 

, 55830 

1 -.22559 

- » 1 64 1 7 

. 38953 

V6 

,55146 

- , 58565 

, 30006 

,73713 

V7 

,60517 

-.41661 

-,20766 

, 58292 

V8 

,45170 

,54153 

- , 22955 

♦54998 

V 9 

, 43472 

, 52352 

,41075 

,63.1.78 

VI 0 

, 23966 

, 7 0879 

- , 1 1 495 

. 57303 

vu 

.49398 

, 42669 

, 52 1 52 

, 69808 

VI 2 

, 43682 

-,21725 

- , 1 6030 

. 26386 

VI 3 

, 58726 

— . 3 0 3 6 6 

- , 39032 

, 58943 

VI 4 

, 54332 

, 20345 

, 07008 

. 34 1 SO 

VI 5 

.47193 

•••• , 06378 

» 37983 

.37105 

VI 6 

.58146 

, 1 1 887 

- , 23283 

.40643 

VI 7 

. 39548 

- , 08428 

- , 40533 

.32780 

VJ.  8 

, 42930 

-.40516 

. 36584 

. 48229 

v:l.  9 

,09042 

.47153 

- , 13407 

. 24849 

V20 

,39481 

, 1 9576 

,47195 

.41694 

V2i 

, 47903 

.43095 

,01722 

.41549 
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TABLE  11 

VARIMAX  ROTATED  FACTOR  MATRIX  £ 


FACTOR  1 

FACTOR  2 

FACTOR 

'v'  1 

♦ 69162 

- « 09866 

*276  1. 9 

V2 

* 31604 

* 70436 

- . 1 2995 

V 

* 54405 

. 16496 

- . 05324 

V4 

.12286 

-*.1.1620  ■ 

*6061.8 

va 

. 59764 

* 0406 1 

* 1 7524 

V6 

♦ 52327 

- * A X 322 

.54090 

V7 

. 73965 

10143 

. 15984 

ve 

♦ 20729 

* . ■ \i  6 8 0 

* 08628 

V 9 

-.11529 

* 5 0582 

< C)  \r  2 .!.  *7 

VI  o 

- . 082  1.  ? 

•>  / \ V '.6  / 

, 06537 

Vi  :i. 

- , 08288 

•%  ? 

. 723 72 

VI 2 

*50192 

<*  \i  1 ) i i 

> i.0918 

VI.  5 

* 76646 

t 04  :: 

* 00330 

V ;i. 

.27801 

<r  •..)  v, 

« vi/3  >2 

VI.  5 

■:  19  078 

> 

. 57849 

V.L 

•4  !*  ' *•  ' 

V ; . iU 

..  14541 

VI.  7 

* 53308 

v 7 7 0 

■ : 1 .1.  08  S 

VI 3 

. ....  .1. 8 V o 

-•  :•  i!L  ...• ./ 

, 551  ' 

VI.  V 

-•  * 0 7 7 '.V>  8 

v ■/  V*  0*  V.' 

' ' ■ ' . 5 .i. 

V20 

i 02855 

' !;  • 

:•  * 

. v*  *89 1 

. .15457 

* 34 

. 50095 

T, Ji.;: 

i'ION  Hr;  VR IX 

factor  i 

I-  Ai  ) 2 

factor  . 

FACTOR 

* 74346 

>3o:i.‘ov 

» 5 i>  8 9 1 

i "Ai  fOr. 

- * 44789 

<•  Li  y 3 4 i.> 

* 033.1.2 

fac  ro: 

• *49666 

-♦27743 

>82173 

Finally  the  factor-scores  corresponding  to  the  rotated  factor  analysis 
are  obtained  by  the  inner  product  of  ^ with  the  column  vectors  of 
G + FP  = S P . These  factor  score  coefficients  are  given  in 

Table  12. 
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TABLE  12 


Vl 

FACTOR  SCORE  COEFFICIENTS 

OF  ROTATED  FACTOR  ANALYSIS 

l-AOTOl-'  i A'...  ! 08  2 

. 1779  ; v9 

fao  > 

, 0386  / 

1 1 

♦ 09?  ->;/ 

•*|  *j  > *.r  ^ 

- > 120 O'  • 

Vo 

, 1A539 

, o30 ' 1 

•••• . 0 8600 

v* 

- » 0204  /. 

••••  v 0.  " - ‘1 

.22500  k 

V5 

. 100 VO r 

“,0 2 

A. 

, 00255 

■Jo 

, 10304 

...  / 

| 7442  ^ 

V..' 

.204..,  ✓ 

■ v v ..,0 'A- 

- * O.i.0;  4 

VO 

v 0 "v  4 *v  \ ' 

* 0--;  ^ 

- > 02/ 07 

: '9 

■•••  <■  1 02  V V 

:•  !!.  •:« 

,21454  * 

Vl.O 

- , 039;.;  / 

-.00718 

v.i.  :i 

•••■ . 1048  ' 

.26283  ✓ 

'i.  2 

. 1 3 7 7 

■■<01027 

. 0 J.  092 

V .!.  3 

♦ 2267V  ✓ 

*C0.3 

- ,001 13 

V 4 

» 0 9 ■ ■ :. 

- a 02 

, 09442 

V :!.  a 

-.00370 

v •.)..>,•:  / a 

, 20087*'" 

V 1. 6 

. 12?."' 

. :.0i:0:".  1 

--,01727 

VI 7 

♦ 1 60 •" 

, 2 ... 

"•.10760 

V :!.  0 

,042'  : 

■■■...  1.^0? 

, 1 8670*"’ 

VI 9 

-.0241  : 

•>  .1  ■:  > ^ 

- ♦ 03504 

V20 

•“,075;! 

i • / *-.■ 

$ ■./  ....  •. 1 ■../  •../ 

, 22948 ✓ 

V2 .1. 

, 00824 

♦ 1 bV  A*>  ^ 

v 06 '7  00 

The  coefficients  greater  than  .15  are  marked  in  Table  12.  This  can  help 
to  provide  proper  interpretation  to  the  factor-scores.  Scattergrams  of  the 
factor-scores  of  the  50  simulated  systems  are  given  in  Figures  3 and  4. 
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Figure  3, 


Sciittcrgr^rn  u£ 


Versus  . 
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Figure  4.  Scattergram  of  Versus  . 
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4.  Detecting  Deterioration  in  Readiness. 
Discrimination  and  Classification 


We  have  seen  in  the  previous  section  that  the  readiness  of  systems 
can  be  represented  by  principal  factors  or  rotated  factors.  This  is  a 
combined  measurement  of  readiness,  which  transforms  the  basic  ORI  scores 
and  reduces  them  to  a small  number  of  orthogonal  factor  scores.  This  repre- 
sentation of  the  readiness  of  systems  is  particularly  useful  for  control 
purposes.  Suppose  that  we  wish  to  follow  the  state  of  readiness  of  a par- 
ticular system.  We  can  periodically  make  observations  on  the  ORI  variables 
and  present  the  corresponding  factor  scores  on  the  scattergrams  given  by 
Figures  3 and  4.  Significant  deterioration  in  readiness  will  be  detected 
by  the  location  of  these  points  in  the  scattergram.  Moreover,  if  a whole 
group  of  points  cluster  on  the  scattergram  on  the  negative  side  of  a factor 
there  may  be  an  indication  that  this  group  originates  from  a different 
population  and  further  analysis  (for  example,  discriminant  analysis  discussed 
later)  should  follow.  Such  a case  was  demonstrated  in  Section  3 and  illus- 
trated in  Figure  2.  In  Figure  5 and  Figure  6 we  illustrate  the  factor 
scores  obtained  by  a rotated  factor  analysis  of  the  21  ORI  variables,  when 
the  sample  of  50  systems  consisted  of  25  units  from  the  distribution 
N(5^>4^.)  and  25  units  from  the  distribution  NQ.,4£)  . As  in  Figure  2, 
the  points  corresponding  to  the  units  in  the  second  subsample  are  circled. 

It  is  seen  again  that  most  of  the  second  subsample  points  are  concentrated 
at  the  negative  part  of  f . There  is  a strong  indication  of  a significant 
difference  between  the  two  subsamples.  The  data  consisting  of  the  two  sub- 
samples presented  in  Figures  5 and  6 were  further  subjected  to  discriminant 
analysis  of  the  SPSS.  In  Appendix  III  we  outline  the  theory  of  discriminant 
analysis.  We  present  here  the  main  ideas  and  results. 

T 

Consider  products  ^ v for  vectors  v in  subsamples  1 and  2. 

Suppose  that  the  observed  vectors  in  subsample  1 follow  the  multivariate 
distribution  and  those  in  sub  sample  2 are  distributed  like 

N^2,4-\P  ‘ The  transf°rmed  variables  w = have  the  normal  distributions, 
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Figure  5. 


Scattergram  of  Factor  Scores,  f2  Versus  , 

in  the  Case  of  Two  Subsamples. 
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Figure  6.  Scattergram  of  Factor  Scores,  Versus  f , 
in  the  Case  of  Two  Subsamples. 
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T T T T 

N(£  ^j)  and  N(£  ^,4^  R$)  » respectively.  The  problem  has  thus 


been  reduced  to  that  of  discriminating  between  two  univariate  samples  from 
normal  distributions.  The  value  of  ^ to  choose  is  that  which  maximizes 
the  F-statistic 


F = 


nln2 

al+a2 


("rV 2 


n 


(4.1) 


where  n^  and  n^  are  the  sizes  of  the  subsamples ? w-^  and  w^  the 

corresponding  sample  means  of  the  w variables,  and  s^  the  pooled  estimate 

of  the  samples  within  variance  of  the  w variables.  The  SPSS  program  pro- 
vides  the  optimal  vector  ^ and  the  variables  which  significantly  influence 
this  discrimination  (those  for  which  the  corresponding  components  of  the 
optimal  are  significantly  different  from  zero.)  The  procedure  according  to 
which  the  variables  are  chosen  to  be  included  in  the  discriminant  analysis 
is  called  a "Step-Wise  Discriminant  Analysis.'  The  reader  is  referred  to 
Afifi  and  Azen  [1]  for  a description  of  the  procedure.  In  addition,  the 
SPSS  program  performs  a classification  procedure,  which  indicates  whether  or 
not  each  one  of  the  vectors  in  the  subsample  belongs  to  the  corresponding 
population  (see  [1]). 


The  results  of  the  SPSS  discriminant  analysis  on  our  simulated  data 
(25  vectors  from  N(5^,4^)  and  25  vectors  from  NQ.,4R))  provide: 

(i)  The  means  of  each  variable,  within  the  subsamples 
and  total; 

(ii)  The  standard  deviations  of  each  variable,  within 
the  subsamples  and  total; 

(iii)  The  matrix  of  within  samples  intercorrelations 
(pooled  estimates) ; 

(iv)  Optimal  coefficients  for  significant  variables; 

(v)  Centroids  of  subsamples,  w^  and  w^  , for  the 
optimal  weights; 

(vi)  Table  of  the  classification  results. 


We  provide  some  of  the  results  in  Tables  13  through  18.  Table  15  presents 
the  actual  classification  for  every  case  in  the  data.  For  each  case  we  obtain 
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TABLE 

13 

SUBSAMPLE  MEANS 

AND 

STANDARD 

DEVIATIONS  OF  ORI  VARIABLES 

GROUP 

COUNTS 

GROUP  1 

GROU 

r, 

r c. 

TOTAL 

COUNT 

£5. 0000 

d 

5. 0000 

5 0 . 0 0 0 0 

MEANS 

GROUP  1 

GROU 

r d 

TOTAL 

VI 

4. 7952 

. 5543 

£ . 675  0 

V2 

4 . 67 9 £ 

1.7124 

3. 1953 

V3 

4.4423 

1 .£££4 

d • o d O 

V4 

5. ] 503 

1 . 533 0 

3. 3694 

V5 

4. 79 S3 

. 3340 

£ . 8 164 

V6 

5.01  OS 

■ •_*  d 

£ • 6 1 3 0 

V7 

5. 1356 

. 4852 

2.3104 

V3 

4. 1 7£4 

1 . 7976 

2 . 935  0 

V9 

3 ■ y 3 6 4 

1 . 1 092 

£ . 4373 

V 1 0 

4. 059 £ 

1.8744 

£ . 9663 

V 1 1 

3 . 9 1 88 

1 . 0672 

2. 4930 

VI  £ 

4.3943 

. £33  0 

2.3164 

V 1 3 

:'?7o 

. 4372 

-•  cr  *7 

L_  • 1 d 

V 1 4 

5 . 3 6 3 6 

1 . £324 

3. £980 

VI 5 

4.4804 

• 69 1 6 

£ . 536 0 

VI 6 

4 . 3 03 0 

1 . 4356 

£.3718 

V 1 7 

4.  0338 

. 737 6 

d a • Z*  C' d 

VIS 

5. 3376 

. 3844 

d • 5 6 1 U 

V 1 9 

4 . 3933 

. 836  0 

£.6174 

V20 

4 • a r'  f' d 

■ 9 3 6 3 

£ • 33£ 0 

V£1 

4. 5320 

1 . 4683 

3. 0004 

STANDARD  DEVIATIONS 

GROUP  1 

GROU 

IP  2 

TDTfiL 

VI 

£. 3791 

1 . 83 1 3 

d . i ij  1 5 6 

o 

£. 393 £ 

£ . 26 1 1 

£ . 7 436 

V 3 

£. 1443 

2.2132 

£.701 3 

V4 

c!  ■ d -•  d d 

1 . 9654 

O "?cr  -I  c 
d • i 1 _» 

» icr 

V J 

£.3352 

1 . 7399 

CL  a 'l'  1 d*  d> 

V6 

£ . 5 1 8 £ 

2.3847 

3. 4035 

V? 

£.  599’ 0 

1 . 7232 

3 . £ 06£ 

VS 

£.£351 

2 . 0562 

£. 4406 

V9 

£ . 0371 

1 . 5795 

£. £790 

V 1 0 

£.3152 

1 . 8633 

£.3545 

VI  1 

1 . 9675 

1 . 4937 

£.£513 

V 1 2 

£ . S 6 £ -9 

1 .4143 

d . a 49 7 

VI  3 

2.3918 

1 . 9273 

;T;  ^ oc rcr  -j 

VI 4 

£. 5920 

£ . 359 1 

•i'  - d d 0 d 

V 1 5 

£. £549 

1 . 6392 

£.7477 

VI 6 

£ . 6'  1 S £ 

1.7 687 

2. 6447 

V 1 7 

1 .7002 

1 . 4123 

£.2745 

V 1 3 

£ . 4 U £ £ 

£.1113 

3. 3570 

V 1 9 

1 . 6359 

1 . 9947 

£ . 549 1 

V2  0 

£.5393 

1 . 9335 

2.9962 

V£1 

£ . 5953 

£ • i‘  £ 1 ( 

3. 0530 

28 
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TABLE  14 

OPTIMAL  DISCRIMINATION  WEIGHTS  AND  SUMMARY 
OF  CLASSIFICATION  RESULTS:  TWO— SUBSAMPLES  DATA 


STANDARD I ZED  DISCRIMINANT  FUNCTION  COEFFICIENTS 

FUNC  1 

13  -.19723 


'15 
'17 
■18 
1 9 


13373 
£36  77 
34179 
fr-iPA 


UNSTANDARD I ZED  D I S( 

FUNC 

V13  -.06059 

V15  -.05049 

V 17  -.1041 0 

V 13  - . 1 0 1 8 1 

VI 9 -.11926 

CONSTANT  1.15571 

CENTROIDS  DF  GROUPS  IN 

FUNC  1 

GROUP  1 -.37363 

GROUP  2 . 37363 


RIM INANT  FUNCTION  COEFFICIENT’ 

1 


REDUCED  SPACE 


D I SCR  I M I N ANT  ANAL VS I S 


FTLE  NONANE 
PREDICTION  RESULTS 

ACTUAL  GROUP 


NO.  OF  PREDICTED  GROUP  MEMBERSHIP 
CASES  GP.  1 GP.  2 


GROUP  1 

GROUP  2 

PERCENT  OF  'GROUPED' 


C _l  . 


M 


CASES  CORRECTLY 


. 0‘; 
0. 
. 0*i 

CLA 


3.  o: 


1 0 0 . 
IFIEIi: 


0*: 

96. Onv 
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TABLE  15 

SPSS  CLASSIFICATION  ANALYSIS  OF  TWO-SUBSAMPLES  DATA 

DISCRIMINANT  ANALYSIS 


CASE 

MISSING 

ACTUAL 

HIGHE 

ST  PROBABILITY 

2ND 

HIGHEST 

DISCR 

SUBFIL 

SEQNUM 

VALUES 

GROUP 

GROUP 

P (Xs 6) 

P Cb''X> 

GROUP 

P (b/X) 

FUNC  . 

NONA 

1. 

0 

1 

1 

.997 

. 993 

c. 

. 0 07 

t-score 

-.60 

NONA 

o _ 

0 

1 

1 

. 996 

. 992 

p 

. 003 

err. 

NONA 

3. 

0 

1 

1 

1 . 0 0 0 

1.  000 

-.96 

NONA 

4. 

0 

1 

1 

. 941 

1. 000 

- 1 . 39 

NONA 

5. 

0 

1 

1 

1 . 0 0 0 

1. 000 

-1.  05 

NONA 

6 . 

0 

1 

1 

. 772 

rr  cr 
• i J ■_» 

£ 

.245 

-.13 

NONA 

7. 

0 

1 

1 

. 999 

1 . 0 0 0 

-1 . 1 0 

NONA 

o 

0 

1 ♦♦♦♦ 

2 

. 7 09 

. 653 

1 

. 342 

. 03 

NONA 

9. 

Cl 

1 

i 

1.00  0 

. 999 

. 001 

-.  32 

NONA 

10. 

o 

1 

i 

. 994 

1 . 0 0 0 

-1.13 

NONA 

11. 

0 

1 

i 

. 934 

. 933 

2 

. 017 

-.  43 

NONA 

1£. 

o 

1 

i 

.631 

1 . 0 0 0 

— 1.74 

NONA 

13. 

0 

1 

i 

.912 

1 . 0 0 0 

-1.45 

NONA 

14. 

0 

1 

i 

. 936 

. 945 

lL 

. 055 

— . X j 

NONA 

10. 

0 

1 

i 

1 . 0 0 0 

. 997 

tZ. 

. 0 03 

”7  r* 

■ i 

NONA 

16. 

0 

1 

i 

1 . 0 0 0 

. 996 

£ 

. 004 

NONA 

17. 

0 

1 

i 

1 . 0 0 0 

. 999 

C. 

. 001 

- . 39 

NONA 

13. 

0 

1 

i 

. 996 

1 . 0 0 0 

-1.16 

NONA 

19. 

0 

1 

i 

.657 

1 . 0 0 0 

-1.72 

NONA 

20. 

o 

1 

i 

. 996 

1.00  0 

-1.1 6 

NONA 

SI. 

o 

1 

i 

. 993 

1 . 0 0 0 

-1.11 

NONA 

C.C.  . 

0 

1 

i 

. 999 

1 . 0 0 0 

- 1 . 03 

NONA 

C • 

0 

1 

i 

. 94  0 

1 . 0 0 0 

f 

- 1 . 33 

NONA 

24. 

0 

1 

i 

1 . 0 0 0 

. 993 

c. 

. 0 02 

a ■'  :< 

MONA 

£5. 

0 

1 ♦♦♦♦ 

c 

. 99 1 

. 933 

1 

.012 

cr  - 

_ TD 
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TABLE  15  (Cont'd) 


NONA 

26  - 

0 

I_ 

iZ 

- 996 

1 . 0 0 LI 

1.16 

NONA 

CL  i**  . 

o 

o 

c 

. 933 

1 . 0 0 0 

1 . £6 

MONA 

iZC*  a 

0 

£ 

o 

i_ 

1 a 0 0 0 

1 . 0 0 0 

1 . 0 C 

NONA 

£9. 

o 

c. 

iZ 

a 932 

1 . 0 0 L'l 

1 . £7 

NONA 

3 0 . 

o 

CL 

iZ 

1 . 0 0 0 

1 . 0 0 0 

. 96 

NONA 

31. 

o 

c. 

2 

. 339 

1 . 0 0 0 

1 . 48 

NOMA 

3£. 

o 

iZ 

lZ 

1 a 0 U 0 

. 998 

1 

. 002 

. 73 

NONA 

•J  w*  • 

0 

c. 

2 

1 . 0 0 0 

. 999 

1 

. 001 

a 9 

HDNA 

► 

3 4 a 

0 

CL 

CL 

. 962 

• 966 

1 

. 034 

.41 

NONA 

-i  rr 

Z*  J a 

0 

lZ 

a O lZ  6 

• 866 

1 

. 172 

. 1 9 

NONA 

36. 

o 

a 

2 

a 997 

1 . 0 0 0 

1.15 

HDNA 

37- 

o 

CL 

2 

1 a 0 0 0 

. 999 

1 

. 001 

. 8 1 

NONA 

33- 

0 

l_ 

iZ 

1 a 0 0 0 

. 998 

1 

a 002 

■ i*  7 

NONA 

3 9 a 

o 

CL 

2 

a 995 

. 991 

1 

. 0 09 

cr  - 

a _>  r 

NONA 

4 0 a 

0 

2 

lZ 

.931 

. 98  0 

1 

. 020 

. 4 7 

NONA 

41  a 

0 

CL 

iZ 

1 a 0 0 0 

1 . 0 0 0 

. 96 

NONA 

42. 

o 

c. 

tZ 

. 969 

. 971 

1 

. 029 

^ “ 

1 

NONA 

43. 

o 

CL 

o 

l_ 

. 999 

1 . 0 0 0 

1 . 0 : 

NONA 

44. 

o 

a 

c. 

. 346 

. 853 

1 

. 147 

. cl  i 

NONA 

45. 

o 

2 

c. 

. 946 

1 . 0 0 0 

1 . 3> 

NONA 

46  - 

0 

c. 

c 

. 94  1 

1 . 0 0 0 

1 . 39 

NONA 

47. 

M 

c. 

c 

1 . 0 0 0 

. 998 

1 

a 0 02 

■ r 

NONA 

43. 

0 

iZ 

c. 

. 334 

• 396 

1 

. 1 04 

* .ii 

NONA 

49  a 

0 

c. 

iZ 

. 999 

1 . 0 0 0 

i . i i.> 

NONA 

5 0 a 

fl 

CL 

*z 

1 a 0 0 0 

1 a 0 0 0 

1 . n 
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TABLE  16 

MEANS  AND  STANDARD  DEVIATIONS  IN  THREE-SUBSAMPLES  DATA 


]j  i.'  S C R I M I N A M T A N A L Y S I S 
I-' ILF.  NUNAME 

group  o u n r s 


GROUP  1 

GROUP  2 

GROUP  3 

TOT  Al... 

(A’.  UNi 

Ml-:  AN  Vi 

20 , 0000 

20 , 0000 

10  * 00 00 

50,0000 

GROUP  1 

GROUP  2 

GROUP  3 

TOTAL 

VI 

5,031 0 

2.7105 

♦ 5590 

3,2034 

V2 

4,4715 

3 , 7320 

1 , 50  . -'0 

3 , 5828 

V3 

4,5505 

3 , 3595 

1 , 24"'0 

3,41.34 

V 4 

5 , 3840 

3 , 1215 

1 , 3 1 V> 

3,6642 

1 i*.. 

v*  ■.  1 

5,1495 

2 , 7830 

. 6580 

3 . 3046 

V6 

5 , 3990 

2 , 5260 

, 6180 

3,2936 

V7 

5,1260 

3,0180 

, 6240 

3 . 3824 

u: : 

4, 1415 

3 , 4705 

1 . 8430 

3,413'-! 

v*? 

4 , 0320 

3 >2315 

, 6820 

3,041.8 

VI 0 

4 , 1 1 40 

4 , 1 905 

, 8990 

3 , 5002 

V 1 :i. 

4 , 3950 

o v 5620 

, 6 1 1 0 

3 , 3050 

V 1 2 

4,2575 

2. 6695 

, 4290 

2,8566 

VI 3 

5, 7155 

2 , 9245 

1 ,2770 

3,71.14 

V ;i.  4 

5 3 :j  75 

3 , 1 925 

1 , 5460 

3,7212 

VI 5 

4,4015 

2 , 7 1 70 

, 8450 

3,0164 

V :i.  6 

4 , 52  45 

2 , 8995 

1 ,5770 

3 > 2850 

VI 7 

A , 4395 

2,7470 

•••• . 0740 

2 , 8598 

via 

4 , 8730 

3 , 02 1 5 

1 ,5610 

3 , 4700 

VI 9 

4 , 8720 

2 , 5500 

, 7880 

3 . 1 264 

V20 

4,9720 

2.9315 

, 4300 

3 , 2474 

V 2 1 

STANDARD 

4 , 1960 
DEVIATIONS 

3, 1010 

, 7660 

3 , 0720 

GROUP  1 

GROUP  2 

GROUP  3 

TOTAL 

VI 

2,3541 

1 , 7500 

1,8069 

2.6126 

V 2 

2 , 5544 

1 8466 

2,9439 

2,5797 

V * 

2,1972 

1 , 8575 

2,453/ 

2 , 4088 

VT 

2,0090 

1 , 9296 

2.1671 

2,5159 

V5 

2 , 6593 

1 , 6224 

2 , 2304 

2 , 7579 

V6 

2 . 4060 

2 , 0832 

3 , 0695 

3 . u 23’j 

V 7 

2 , 4964 

1 <•  6689 

1.9315 

2,6513 

VO 

1 ,8132 

2 , 3947 

.1. , 9 1 1 1 

2,21 1.4 

V9 

2, 1418 

1 , 8432 

1,5271 

2 , 2529 

VI 0 

2 , 31 1 1 

1 > 9372 

1 . 9083 

2,4355 

V :l.  :i. 

1 , 9606 

1 , 3739 

1 ••  1.845 

2 , 1 1 50 

VI 2 

2 , 1 020 

1 , 3309 

1.6635 

2,2195 

VI 3 

2 , 1026 

2 , 0098 

2 , 6209 

2 , 7647 

VI 4 

2,1783 

2.1930 

2 . 8563 

2,7109 

VIS 

1 , 9903 

1 , 5579 

1 . 657 1 

2.1825 

V 1 6 

2 , 3402 

1 > 7939 

1 .3197 

2 . 2303 

VI 7 

1 , 7879 

1 , 3360 

1 , 7604 

2 . 298 1 

V 1 8 

1 , 4830 

2 . 2807 

2,4704 

2 , 3706 

VI 9 

1,8112 

1 , 4623 

1 , 9360 

2 ♦ 2989 

V20 

1 v 7233 

1 . 8880 

2 . 0608 

2,4877 

V21 

2,2607 

2.3748 
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TABLE  17 

SUMMARY  OF  DISCRIMINANT  ANALYSIS 
STATISTICS  THREE-SUBSAMPLES  DATA 


STANDARD I ZED  D I SCR I ri  1 MAN  V 

F U N C T 1 0 N C 0 E I F f C I E i ! T S 

FUNC  1 

FUNC  2 

08 

. 18405 

- . 1 4479 

09 

- * 1 2608 

- . 59925 

0:i.  0 

•••• , 1 4394 

- . 78555 

012 

- . 24636 

- . 1. 7434 

0 :l.  3 

-.04710 

,82144 

014 

1.3662 

. 17005 

01/ 

-.41260 

- . 3593 3 

018 

- v 1 7682 

.27193 

Oi.9 

- . 26 1 87 

. 53829 

UN STANDARDIZED 

D I S C R I M I N A M T F IJ  N C T 1 0 N 

COPT  FICIEN  I S 

FUNC  1 

FUNC  2 

vw 

.08323 

-•  * 0 V*  v * / 

09 

•••• . OS  596 

010 

-.05910 

«::*  / 

012 

-.11100 

.07055 

013 

-.01704 

.29712 

0 :i  4 

- . 05040 

. 0*2  -T3 

017 

-.17954 

•••• . 1 5628 

0 1 8 

-.07459 

. 11 4 71 

019 

-.11391 

.23415 

CONSTANT 

1 . 78926 

. 36658 

C E N T R 0 1 D S 0 F G R 0 U P S I N R E D U C E D S P A C E 

FUNC  1 

FUNC  2 

GROUP  1 

-.88931 

. 40058 

GROUP  2 

. 1 3352 

- . 69790 

GROUP  3 

1.51157 

. 59464 

0 1 S C R I ri  1 N A N T A N A i...  Y 8 

1 S 

FILE  NONANE 

PREDICT I ON  RESULTS 

* 

NO,  OF 

PREDICTED 

GROUP  0 iirt; BLR  SHIP 

A C l UAL  GROUP 

0 i-i  S E S 

0 P . 1 

UP.  2 OP. 

GROUP  1 

20 . 

1 9 > 

.1.  i 

95  . OZ 

5 . 0% 

GROUP  2 

20  . 

1 . 

1 ? . 

5,0% 

95 , OZ 

GROUP  3 

1 0 . 

0. 

1 , 

,0% 

10.0%  9 

0. 

♦ 0% 
0. 
, oz 

9* 


P E R C E N T 0 F ' G R 0 U P E D ' CAS E S C 0 R R E C T L Y C L A S S I F I E D i 9 4 . 0 0 % 
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TABLE  18 

CLASSIFICATION  ANALYSIS  OF  THREE- SUBSAMPLES  DATA 


ACTUAL 

H1.GHL8 

i PROBABILITY 

2ND 

H IP  Hi::  .\> 

DISCRIMINANT  8 COR  II 8 

UNUii 

GROUP 

GROUP 

!■'  ( X/G ) 

P<G/X> 

GROUP 

p ( i.o  / x * 

R.JNC  1 

FUNG  2 

:i. . 

1 

.i 

, 999 

« 7 3 5 

*•;> 

•• . 634 

-• , 283 

2 * 

:i. 

:i 

, 962 

<4  O 

4>  / V..'  • J 

•*'  i 

A*. 

* 0 .1.  S 

-,610 

1 .764 

3, 

1. 

:i. 

, V 9 / 

, 987 

•‘3 

♦ 0 1 Z 

<•  / u 

1 , 399 

4, 

1 

i. 

. 982 

. 998 

A*.! 

* 00  7 

- 1 , 1 1 9 

1,632 

5 (• 

1 

:i. 

, 999 

, 998 

O 

* 002 

•■•1 , 386 

.399 

6* 

1 

1 

♦ 982 

>638 

- , 1 96 

.763 

/ * 

:i. 

:i. 

1 . 000 

. 948 

7 

» OS  2 

-.779 

» 4 6 6 

8 , 

l 

, 999 

♦ 910 

3 

, 063 

, 597 

- , 003 

<•) 

/ <■ 

i. 

1 

1 , 000 

, 76-‘> 

•••> 

,234 

-,612 

-■ , 1 1 3 

10. 

1 

% 

,999 

, 964 

, 056 

-1 . 1 23 

- , 33 1 

:l.  .1  . 

i 

1 

, 999 

. 682 

-y 

.318 

- , 603 

•••■ , 352 

1 2 . 

J. 

:l. 

,948 

1 , OOO 

■ 1 , 704 

. 800 

1.3, 

1 

1 

, 962 

1 , ooo 

■ 1 , 629 

,980 

1.  4 , 

1 

1 

:i  ,ooo 

♦ 391 

2 

, 109 

- , 620 

♦ 441  ■ 

:i.  5 , 

:l 

:i  ♦ ooo 

,949 

, 05:i 

• , 632 

, 922 

.1. . 

■! 

;t. 

, 997 

. 8 1. 9 

, .1. 8 1 

- , 367 

♦ 037 

.1. 7 • 

1 

i 

1 , 000 

< 963 

, 037 

-1 , 109 

- , 3 :l  4 . 

18- 

:i. 

1. 

,699 

, 90 1 

7 

, 099 

-1,304 

-.1.  ,566 

1 9 , 

i 

:l 

, 534 

< 9 78 

•:> 

, 002 

~1 ,959 

- ,945 

20, 

:l. 

i 

,998 

,996 

, 004 

-1.027 

1 , 3 1 6 . 

2.1. 

7 

1 , 000 
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the  likelihood  of  the  observation,  given  the  group  P[$|G]  and  the  Bayes 
posterior  probability  of  the  group,  given  £ . We  see  in  Table  15  two  cases 
in  group  1 that  behave  like  the  cases  of  group  2. 

The  discriminant  analysis  becomes  more  complicated,  but  at  the  same 
time  more  interesting,  when  the  number  of  subsamples  (groups)  is  greater 
than  two.  Generally,  if  the  number  of  subsamples  is  k , the  analysis  is 
done  by  computing  k-1  discriminant  functions,  which  maximize  F-statistics 

that  can  be  obtained  by  k-1  orthogonal  vectors  £ ^ (i=l, . . . ,k-l)  . 

The  results  are  then  plotted  on  a 2-dimensional  graph,  with  orthogonal  axes 
representing  the  first  two  discriminant  functions.  We  illustrate  this  in  the 
following  example,  analyzed  by  the  SPSS  program,  on  three  subsamples  of  sizes 
= ?n  = 20  and  n = 10  . The  cases  in  these  subsamples  were  simulated 

according  to  the  multinormal  distributions  N(5^,4£)  , N(2^-,4R)  and  NQ..4JI)  , 
respectively.  The  scattergram  in  Figure  7 shows  that  one  can  well  discriminate 
between  these  subsamples  by  means  of  this  analysis.  We  also  learn  from  the 
analysis  that  only  variables  vg,  vg , v1Q,  v^,  v^,  v^,  v^,  vlg  and 
contribute  significantly  to  the  discrimination. 
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Figure  7.  Scattergram  of  Discriminant  Scores. 
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APPENDIX  I 

SIMULATING  MULTIVARIATE  NORMAL  VECTORS 

The  simulation  of  p-dimensional  multivariate  normal  vectors  is  based 
on  the  following  well— known  result  (see  T.  W.  Anderson  [2]). 


Let  ^ = [x^, ,x  ] be  distributed  like  N(^,^)  . Suppose 


that 


.(1) 


• = [xr...,xr]T  and  £(2)  = [x^ , . . - ,xp]  ‘ .for  1 < r < p . 
the  partition 

r,(D- 

% 


Consider 


(2) 


and 


1 = 


hi  ih; 


t ' % 

<t  21  i%22 


where  £ <'1'>  is  rxl-dimensional,  is  (p-r)xl-dimensional,  1 is 

* * 11 
rxr  and  is  (p-r)x(p-r)  . Then,  the  conditional  distribution  of 

, given  , is  the  multivariate  normal  N(£2  P ’ wtiere 


<2.1  -<22>+Wu^a,-<(1) 


(A. 1.1) 


-1 


h2.i  <?22  hi  hi  h.2 


Let  ^ be  a diagonal  matrix  consisting  of  the  diagonal  elements  of  ^ 

i.e.  , D = diag  (ct-  , . • . 3 

'Xi  xx 

^ by  the  relationship 


i.e.,  D = diag(a  , . . . ,a  ) . The  correlation  matrix  R is  obtained  from 
11  pp  ^ 
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l ■ «1/2  « e1/2 


(A. 1.2) 


Thus,  if  ^ is  a p-dimensional  standard  multivariate  normal  vector,  i.e., 

^ ^ N(^»^)  , then 

1/9 

(A. 1.3) 


« ■ 4 + «1/2>i 


We  consider  now  the  problem  of  simulating  ^ . Suppose  we  have  a procedure 
for  simulating  independent  standard  normal  random  variables,  z^9z  9..m  ; 

z±  ^ N (0 , 1)  , i - 1,2,...  we  set  z\  * The  conditional  distribution  of 

2 

u2  , given  u1  is  N(P12U]_»  l-p12)  , where  p12  is  the  correlation  between 
u^  and  u^  . Accordingly,  given  u^  , we  obtain  u^  by  the  formula 

2U1  + (1_P12)1/2z2  (A-1*4) 


U2  P12' 


Suppose  we  have  already  simulated  the  values  of  u (k=l,2, . . . ,p-l) 

12k  * 


Let 


fi 


(k) 


designate  this  vector.  The  conditional  distribution  of  u 


.00 


k+1  » 


given  is  obtained  according  to  (A. 1.1)  in  the  following  manner.  Let 

the  correlation  matrix  of  ^ ^ . Consider  the  partition 


* 


(k+1)  _ 


^(k)  , p(k) 


(k)T  i 


1 'U 


(A. 1.5) 


, (k) 

where  p 

is  the  vector  of  correlations  between 

u 

% 

k+1 

nf  (k) 
of  ^ 

Hence,  the  conditional  distribution  of 

Uk+1 

normal  with 

conditional  expectation 

.(k) 


n, 


■ku  ■ eK+i'4  ■ 

and  conditional  variance 


-1  (k) 


(A. 1.6) 
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lc+1 


- 1 - (p«)T(^k>>-1(p«) 

n . W rv. 


(A. 1.7) 


Finally,  is  determined  by  the  formula 

“k+l  = \+l  + Tk+1  * zk+l  5 k = i*2.-*-.?-1 


(A.1.8) 


An  alternative  approach  for  simulating  the  vector  ^ is  as  follows: 

T 

Let  £ be  a non-singular  matrix  such  that  R = . Simulate  p i.i.d. 

T 

N(0,1)  random  variables  z_,...,z  . Let  z = [z-,...,z  ] . Then 

1 p 'w  1 p 

(A. 1.9) 
The  matrix 


% = $ * 


has  the  standard  multivariate  normal  distribution 


1/2 


where  ^ is  a matrix  whose  columns  are  the  p eigenvectors  of 


^ and  J\.  is  a diagonal  matrix  of  the  eigenvalues  of  ^ 
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APPENDIX  II 

PRINCIPAL  AND  ROTATED  FACTOR  ANALYSIS 


Let  ^ ^ N(j^),:|l)  be  a standard  multivariate  normal  vector.  The 

distribution  of  is  like  that  of  N(0,£TR2,)  . Let  > X2  > . . . > Ap  > 0 

be  the  eigenvalues  of  . We  wish  to  determine  a vector  (functional)  l , 
with  length  | |&|  | = 1 , which  maximizes  the  variance  of  . The 

Lagrangian  is 

= - ^CtV1)  (A.  2.1) 

Differentiating  f(^/,A)  with  respect  to  ^ yields  the  eigenstructure  equation 

£&°  = Al^°  (A. 2. 2) 

Notice  that 

£TR£  = A£T£  = X 


Thus,  is  an  eigenvector  of  ^ 

to  the  largest  eigenvalue  of  ^ , namely  to^ 

*(1)T«  • 


, of  unit  length,  corresponding 
A^  which  is  the  variance  of 


Similarly,  let  be  the  eigenvectors  of  unit  length 

of  JJ.  , corresponding  to  A^,...^^  . Notice  that  the  variance  of 

^s  ^ (i=l,...,p)  and  that 

cov(^(l)T%4(:i)T%)  = 0 . a11  i + j • (A. 2. 2) 

(i)  Ti^  T 

Indeed,  if  ^ jL  , i = l,...,p  , then  the  spectral 

decomposition  of  is 

$ = ^ % (A. 2. 3) 

3=1 
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Furthermore,  for  any  i / j 


/0(i)T  „(j)T  , _ 0(i)T  (j) 

cov^  ’ k & k R£ 


= l 


(A. 2.4) 


k=l 

(1)  0(P) 


Ak% 


Let  ^ , . . . ' ) be  an  orthogonal  matrix  with  columns  which 

are  the  eigenvectors  of  Jl  . The  distribution  of 


t ' fm£>i 


(A. 2. 5) 


is  like  that  of  N(Q,;Q  ; where  = diag (X^, . . . , X^)  . Indeed, 

% N(£,£T]^5)  . But  = /V  . The  components  of  £ are  called  the 

principal  factor  scores,  corresponding  to  u . The  orthogonal  transformation 

of  ^ given  by  (A. 2. 5)  yields  independent  standard  normal  random  variables. 

P 

Since  trace  = trace  /V  = E X_^  = p , the  ratio  X^/p  (i-1, . . . ,p) 

i=l 

is  the  proportion  of  the  total  variance  of  ^ accounted  for  by 
f (1=1,..., p)  . If  we  choose  only  the  first  m (l<m<p)  eigenvectors  of 

, corresponding  to  X^  >.  . .>  X^  , and  define  - ***•'&  ^ 


o-(m) 
-1/2t 


/V(m)  = diag(X1,...,Xm)  , the  transformation  ^(m)  £(m)  u yields  the  first 

m components  of  £ . The  concepts  of  communality  and  the  nature  of  rotated 
factor  analysis  was  explained  in  Section  3. 
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APPENDIX  III 
DISCRIMINANT  ANALYSIS 


Suppose  there  are  k groups  (from  different  populations).  We  assume 

that  these  groups  constitute  random  samples  (of  systems)  of  size 

k 

n-  (i=l,...,k)  . Let  N = £ n.  be  the  total  number  of  observations.  Each 

i=l  1 

observation  is  represented  by  a p-dimensional  random  vector,  ^ , having  a 
multivariate  normal  distribution  like  N(jj.,^)  . 

We  define  the  following  sample  statistics. 

The  within  groups  sample  covariance  matrices 


} ’ i - 1, . . . ,k 


where 


.(i) 

Jj 


(A. 3.1) 


(A. 3. 2) 


is  the  sample  covariance  between  x^  and  x^ , within  the  ith  group 

(i- 1>  • • • jk;  j , j =1, . . . ,p)  ; and  x^.  (i=l, . . . ,k; j=l, . . . ,p)  is  the  ith  group 

mean  of  the  jth  variable.  The  pooled  within  covariance  matrix  is 

k 


« - ss  J ‘v15  |(il 

\ ' 

V . 

Similarly,  we  define  the  between  sampled  covariance  matrix 

t 

$ = . ;j’ »j '=1,  • • • ,p]  , where 

. 1 y ,-(i)  = w-(i)  = . 

b^>  = T~T  2 n.j  (*.  -x  )(x./-x.) 


(A. 3. 3) 


JJ 


k-1  . ..  i j 
i=l  J 


(A. 3.4) 


-(i) 


with  x - — E n.  x , as  the  grand  mean  of  the  jth  variable  j = l,...,p 
J i=1  1 3 
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If  L = ^ , an  F-test  of  the  significance  of  differences  between 
the  centroids  of  the  k groups  is 


= 


A 


& gT| 


(A. 3. 5) 


We  determine  ft  to  maximize  . Notice  that  W is  non-singular  with 
probability  one  and  the  rank  o£  ft  is  k-1  . Differentiating  with 
respect  to  £ yields  the  gradient 


v*v 


[(a)  % - (&  %)«] 


(A.  3 . 6) 


Thus,  the  vector  £ which  maximizes  F^  should  satisfy  the  equation 


(A. 3. 7) 


or  by  multiplying  (A.3.7)  by  JJ  1 we  obtain  the  eigenstructure 


Of  A * Fft4 


(A. 3. 8) 


where  is  positive  semi-definite,  of  rank  k 1 . 


t t-  > > X >•••>  A > 0 be  the  ordered  positive  eigenvalues 

-CL  __  2 = = k— 1 

of  W_1B  . Let  , i = 1,  • • • jk-1  be  the  corresponding  eigenvectors 

(of  length  1).  The  functions 


j = o(i)T 

di  ^ £ ’ 


i = 1 , . . . ,k-l 


(A. 3. 9) 


are  the  discriminant  scores  corresponding  to  the  vector  £ . The  eigenvalue 

A1  is  the  maximal  F^  statistic,  A,,  is  the  second  largest,  etc.  In 

Section  A,  the  discriminant  vectors  (functions)  £ (l)  as  well  as  the 
discriminant  scores  are  presented.  In  the  case  of  k > 3 it  is  customary 
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to  present  the  points  eac^  case  graphically,  on  orthogonal 

systems  of  axes.  Note  that  although  is  orthogonal  to  ^ , 

\j  f\j 

i,i'  = , the  random  variables  are  not  necessarily 

uncorrelated. 


i 
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APPENDIX  IV 
COMPUTER  PROGRAMS 


In  the  present  appendix  we  provide  two  computer  programs:  (i)  Program 

SIMU  and  (ii)  Program  SN0R2 . 

Program  SIMU,  in  FORTRAN,  provides  a complete  package  of  simulating 
6-variable  multinormal  random  vectors,  according  to  given  distribution  means, 
standard  deviations,  and  correlation  matrix.  The  simulated  random  vectors 
are  then  subjected  to  principal  factor  analysis.  The  program  computes  and 
prints  the  simulated  sample  means,  standard  deviations,  and  correlation 
matrix;  it  applies  a library  subroutine  program  to  determine  the  eigenvalues 
and  unit  length  eigenvectors  and  prints  these  statistics.  After  this  the 
program  computes  the  principal  factor  scores  and  applies  a two-dimensional 
graphics  subroutine  to  present  the  scattergram  of  f2  versus  . 

Program  SN0R2  was  designed  to  simulate  21-variable  multinormal  vectors 
and  prepare  the  result  for  use  in  subsequent  SPSS  analysis  by  batch  process. 

The  computations  of  all  subprograms  were  performed  on  a Honeywell  GE-430 
time-sharing  computer.  The  results  were  merged  in  a proper  manner  and  copied 
into  a tape  from  which  the  batch  was  then  read  into  a UNIVAC  1108  computer 
for  the  SPSS  analysis.  In  the  following  we  provide  specific  explanation  of 
the  two  programs  and  copies  of  the  programs . 

4.1  PROGRAM  SIMU 

Block  Lines  Designation 

] 100-130  Specific  merging  of  library  subroutine 

functions  for 

(i)  Solving  linear  equations:  LINEQ 

(ii)  Finding  eigenvalues  and  eigenvectors 
of  a symmetric  matrix:  EIG1 

(iii)-(iv)  Simulating  standard  normal  variates: 
XNORM,  RANDX. 

2 140-230  Dimension  statements  and  definition  of  constants. 
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Lines 

250-320 

330-390 

400-870 

880-970 

980-1080 

1090-1200 

1210 

1220-1310 

1320-1440 

1450-1600 

1610 

1640-end 


Designation 

Reading  means,  standard-deviations  and 
correlations  parameters  from  a data  file 
"C0RR". 

Setting  initial  zero  values  for  sums,  sum 
of  squares,  and  sum  of  products  of  simulated 
variables . 

Recursive  simulation  of  50  6-dimensional 
multinormal  vectors  and  computing  their  sums, 
sum  of  squares,  and  sum  of  products. 

Computing  sample  means,  sample  standard 
deviations,  and  sample  correlations  of  the 
simulated  vectors. 

Printing  the  sample  means,  standard-deviations, 
and  correlation  matrix. 


Preparation  for  computation  of  eigenvalues  and 
eigenvectors  of  sample  correlation  matrix. 

Computation  of  eigenvalues  and  eigenvectors 
of  sample  correlation  matrix. 

Printing  of  eigenvalues  and  eigenvectors. 

Ordering  the  eigenvectors  corresponding  to  the 
M largest  eigenvalues. 

Computing  and  printing  the  M factor  scores. 

Graphing  the  2-dimensional  scattergram  of 
f^  versus  f . 

Subroutine  Program  PLT1(N,*,«) 


PROGRAM  SN0R2 


Lines 


Designation 


100-130 


Merging  library  subroutine  programs  for 

(i)  Solving  linear  equations:  LINEQ 
(ii)-(iii)  Simulating  standard  normal  deviates: 
XNORM,  RANDX. 
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Block 

Lines 

Designation 

2 

140-240 

Dimension  statements  and  definition  of 

constants. 

3 

, 250-320 

Reading  means,  standard-deviations  and  correla- 
tions of  21  variables,  from  data  file  "CORR”. 

4 

330-390 

Setting  initial  zero  values  for  sums,  sum  of 
squares,  and  sum  of  products. 

5 

392-875 

Recursive  simulations  of  21-dimensional 
multinormal  vectors  and  writing  the  results 
directly  into  computer  file  "RSC0RE". 

6 

880-1085 

Computing  the  sample  means,  standard  deviations 
and  intercorrelations  of  the  21  variables  and 
writing  the  results  into  files  "SMNS"  and  "MATRIX”. 

7 

1090 

END . 
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PROGRAM  SIMU 


S I MU 


13:  33 


CHI 


CRT  1 0-  - 1 4.^73 


I 0 0'£L  I B t L I NEQ  - t y *■>+- 

I I 0$L  I B y E I G 1 - .-  - 


13  0'ELI  By 

i .i 

NORM  - y y 

1 3 f 'EL  I By 

R H N D X y y y ♦ ♦♦ 

14  & 

DIMENSION 

150 

D I MENS  I ON 

1 6 0 

DIMENSION 

170 

DIMENSION 

1 3 0 

D I MENS  I ON 

1 35 

DIMENSION 

190 

K=6 

3 0 0 

M=3 

31  0 

;<k=k-  1 

33  0 

N=5  0 

33  0 

RN=N 

34  0 

U=XNORM  C-l 

350 

CALL  OPENF 

360 

READ  C 1 - 1 

37  0 

i 

FORMAT C6F3 

33  0 

RERD  Cl » 1> 

39  0 

DO  3 1=1 yK 

3 0 0 

RERD  C 1.-2  ■' 

3 1 0 

z> 

L_ 

FORMAT C6F3 

33  0 

■C1 

CONTINUE 

330 

DO  25  1 = 1 yl 

3 4 0 

T < I > = 0 . 

35  0 

ECU  C 1 = 0 . 

36  0 

DO  3 0 J = l.-! 

370 

P C I - J>  = 0 . 

33  0 3 

Ij 

CONTINUE 

390  3 

. J 

CONTINUE 

& } f R C6y  6>  ; H V ( t? ) .-  S D 6 .-  Z 

fc*  y P 13  ? fa ) ? £ M *•.  .**  y £ fa  3 b .-1  y 

Ul  <5  0 * 6>  y EG  <6  y 6>  .»  TEMP  1 <6>  9 
EL  C4>  y IT  <4>  9 Y 050*3} 

RM  C50}  y F 1 »C50>  y F3  <50} 

C.  \j  L < fa  y .) 


Cly "CORR"> 
(flV(I)  » 1 = 1-10 

. 2> 

ecu  a>  - 1 = 1-10 
(R(I»J)  .-  J=l-K> 


K 


4 00  DO  5 1=1- n 

43  0 3 0 0 U = X r 1 □ R M < 0 . > 

460  z C 1 > =U 

4 7 0 X C 1 > =ftV  C 1 > +SIi  C 1 > ►Z  < 1 > 

43  0 li.i  >;I  - 1 [> 

4 3 0 T C 1)  — T C 1 ) +X  C 1 ’> 

3 00  E C D C 1 > = E C D C 1 > + X C 1 > +X  C 1 > 

510  U=XNORM CO. > 

520  Z C2>  =R  C 1 y 2)  >Z  C 1 > +U ►CQRT  Cl  . -R  Cl  y 2>  +R 

530  X C2>  =flV  CEO  +CD  C2>  ►Z  C£> 

340  l.l  C I y 2>  =X  C2> 

53  0 T C2>  =T  C2..'  +-X  C 2 ) 

56  0 ECD  C2>  =ECD  C2>  +X  C2>  ►X  C2> 

570  DO  6 J=3 tK 


C6>  t C C5 .-  5>  y B C5>  - E C5> 
ER  (b  - 6 

TEMP2  C6>  .-  T C6>  - EH  C2 1 '■ 
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* 530 
59  0 
6 0 0 
6 1 0 
620 

63  0 

64  0 
6 5 0 

6 6 U 
670 
63  0 
69  0 

7 0 0 
710 
720 
73  0 
740 
750 
760 
77  0 
730 
790 

8 0 0 
3 1 0 
320 

33  0 

34  0 

35  0 

36  0 


JJaJ-1 

no  7 L 1 = 1 .» J J 

no  s L2=i »j j 

C CL1  .•  L(2>  =R  CL1  » L£> 

8 CONTINUE 
7 CONTINUE 

DO  9 L 1 = 1 .*  J J 
B CL  1 > =R  CL  1 .*  J> 
E<L1>=B<L1> 

9 CONTINUE 

CALL  L I NEQ  <C B t J J 1 j KK> 
R'SQ=  0 . 

H-0. 

no  10  l i = i j j J 
!H=H+B  CL 1 > *Z  <L1> 
RSQ=RSQ+B  CL 1 > >E  CL 1 > 

10  CONTINUE 
U=XNORM C 0 . > 

Z C J>  =H+U  ►SORT  C 1 . -RSQ> 

X CJ?.'  =AV  CJ!-1  +SD  C J>  ♦Z  C J.-1 
U c i » j)  =x  CJ> 

T <j;-i  =t  CJ>  +X  < J> 

£SD  C J>  — E3D  <J>  +X  C J ) >X  <J> 
6 CONTINUE 
DO  66  L-l > K 
HO  67  J — 1 j K 

P CL?  J>  -P  CLj  J>  +X  CL)  ►X  C J> 
67  CONTINUE 
66  CONTINUE 


37  0 


5 CONTINUE 


33  0 

no  70  1=1 tK 

39  0 

EM  CD  =T  CI>  -'  AN 

9 0 0 

V I = C AN*£S0  C I .)  -T  C I > vr  C I > > ✓ CAN-*'  CAN- 1 . > > 

9 1 0 

ESn C I > =SQRT C V I > 

920 

no  7i  j = i * i 

93  0 

Q I J=  CAN+P  C I r J>  -T  C I > ►T  C J>  > ✓ CAN*  CAN- 1 . > > 

94  0 

ER  C I ? J> =Q I J/ CESn C I > ♦ESB  <J> > 

950 

ERC-Jj  I>  =ER  Cl  >-J) 

9 6 0 

71 

CONTINUE 

970 

7 0 

CONTINUE 

930 

PRINT  3 0 .»■ 

990 

30 

FORMAT C5Xr "SAMPLE  MEANS  AND  STAND. DEV. " y 

100  0 

PRINT  35 ? CEM  C I > , I = 1 r K> 

1 010 

PRINT  85 .*  CESD  C I > r I = 1 t K> 

1 02  0 

35  FORMAT C5X > 6F 1 0 . 3> 

1 030 

PRINT  9 0 t 

104  0 

90  FORMAT  C'-'r5X.»  "CORRELATIONS  MATRIX"  .» / s') 

1 05  0 

no  91  I = 1»K 

//') 
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1 06  0 

PR  I NT  32  ? <ER  < I ? J>  ? J=1  ? SO 

1 07  0 

32 

FORMAT <5X ? 6F 1 0 . 6> 

1 03  0 

91 

CONTINUE 

1 03  0 

DO  33  1 = 1?  K 

1 1 0 0 

DO  34  J = I ? K 

1110 

IF  <1  — 1>  35? 35? 36 

112  0 

95 

I J =J 

1130 

GD  TO  33 

114  0 

96  : 

[ F < I -2>  37? 37? 38 

1 15  0 

97 

I J-54J 

1 1 6 0 

GO  TO  33 

1 17  0 

93 

i j=  a - 1 > >k-  i a - 1 > .--2+j 

1 13  0 

99 

eh  a j>  =er  a?  j> 

1 13  0 

94 

CONTINUE 

1 2 0 0 

93 

CONTINUE 

1210 

C'HLL  E I G 1 <EH  ? EG  ? K ? 2 . 0E- 12?  TEMP  1 ? TENF'2  ? 1 ? K> 

122  0 

PRINT  100? 

123  0 

1 0 0 

FORMRT  C'-''  ? 5X  ? “ E I GEN  VALUES  OF  CORREL . MflTR  I X " ? 

1 24  0 

P R INT  11 0 ? CEH < J > ? • J = 1 ? K > 

1250 

110 

FORMAT <5X?6F10.6> 

126  0 

PRINT  120? 

127  0 

12  0 

FORMAT  <>'.••' ? "EIGENVECTORS"?/^:) 

1 23  0 

DO  130  1=1 ?K 

123  0 

PRINT  1 4 0 ? < E G < I ? J > ? J = 1 ? K > 

1 3 0 0 

1 4 0 

FORMAT  <5X?6F  1 0.6.) 

131  0 

1 3 0 

CONTINUE 

1320  EL  <1>  =EH<1> 

1330  IT(1)=1 

1340  1*13  160  L=1?M 

1 3 5 0 D 0 130  1 = 1 ? K 

136  0 IF  <EL  <L> -EH  <I>>  145? 145? 150 

137  0 145  EL  <L> =EH < I > 

1380  IT  <L> = 1 

1330  150  CONTINUE 

14  00  LTI  = IT<L> 

14  05  DO  165  J=1 ? K 

1 4 07  EGG  CJ  ? L.)  =EG  CJ  ? LT I • 

1403  165  CONTINUE 


1410 

142  0 

143  0 
1440 

145  0 

1 46  0 
1 47  0 
143  0 
1430 
1 5 0 0 


EH<LTI>®0. 

IT  <L+1>  = 1 
EL  <L  + 1>  =EH  <1> 

160  CONTINUE 
PRINT  200? 

2 0 0 FORMftT  <//  ? 5X ? ” F ftCTDR  SCORES " ? //> 
DO  170  1=1 ?N 

ana>=i 
no  175  L= 1 ?M 
V < I ? L)  = 0 . 
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1510 

1520 

1 53  0 

154  0 

1 35  0 

136  0 
157  0 
153  0 
159  0 
1 6 0 0 
1 6 1 0 

1 63  0 

164  0 

165  0 

1 66  0 

167  0 

168  0 
169  0 
1 7 0 0 
1710 
1720 
if  3 0 
174  0 
1750 

176  0 

177  0 

178  0 

179  0 
1 3 0 0 
1310 
132  0 
1330 
184  0 

1 35  0 

136  0 

1 37  0 
1 83  0 
1 39  0 
1 9 0 0 

191  0 

192  0 

193  0 

194  0 
1950 
196  0 
1370 


H □ 130  J=lfK 

y i'  i , L>  =Y  < I ? L>  *EGG  < J .»  L>  *•  <W  < I ? J>  -EM  <J>  > ••••'ESD  <J> 

130  CONTINUE 

V I ? L>  =Y  I ? L>  /SORT  <EL  L ) 

175  CONTINUE 

PR  I NT  210?  It  Or  < I ? L>  ? L=  1 ? M> 

2 1 0 FORMAT <5X ? 1 4 ? 3F 1 0 . 4> 

FI  (I)=V(1j  1) 

F 2 <1  I > — Y ( I ? 2 .J 
170  CONTINUE 

CALL  PLT 1 <N?F 1 ? F2> 

END 

SUBROUT I NE  PLT 1 <N? X ? Y> 

DIMENSION  X<1>  ?YC1> 

CALL  PSET  <XM I N ? KM AX  ? YM I N ? YMAX> 

CALL  SPLT 1 <N ? X ? Y ? XM I N ? XM AX ? YM I N ? YMAX> 

RETURN 

END 

SUBROUT I NE  PSET  <XM I N ? XMAX  ? YM I N ? YMAX> 

XM I N-2. 

XMAX=1 . 

YMIN=2. 

YMAX= 1 - 

RETURN 

END 

SUBROUT  I NE  SPLT 1 <N ? X ? Y ? XM IN?  XMAX  ? YM I N ? YMAX> 

DIME  N S ION  X < 1 > ? Y <■.  1 > ? X S C L < 6 1 ) ? Y S C L < 2 1 > ? I L I N E < 6 1 :> 

I F <XM I N-XMAX)  2? 3? 3 
3 CALL  A M A X < N ? X ? X M I N ? X M A X > 

2 I F Ov’M I N-YMAX>  7?  6?  6 

6 CALL  AMAX  <N ? Y ? YM I N ? YMAX> 

7 CALL  F'SCL  < 1 ? XM  I N ? SCALX  ? YM  AX  ? R ? XSCL  ? YSCL  ? YM  I N ? XMAX> 
CALL  GZRO  <0? ILINE> 

DO  12  K=1 ? 21 
CALL  GZRO  <K? ILINE> 

CALL  SKPT  <N ? K ? X ? Y ? YSCL  ? XM IN? SCALX ? I L I NE ? 1 ? R> 

CALL  T YP I T <K ? YSCL » I LI NE> 

12  CONTINUE 

CALL  GZRO  <0? ILINE> 

CALL  PS CL <2? XM I N? SCALX ? YMAX ? R ? XSCL ? YSCL ? YM I N ? XMAX> 

RETURN 

END 

SUBROUTINE  AMAX  <N?X?XMIN?XMRX> 

DIMENSION  X<1> 

XMIN=X<1> 

XMAX=X < 1 > 
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1 93  ij 
1 990 
2 0 0 0 
£ 0 1 0 
£ 02  0 
£030 
£04  0 
£050 
£ 06  0 
£ 07  0 
£ 03  0 
£03  0 
£ 1 0 0 
£ 1 1 0 
£120 
£13  0 
£ 1 4 0 
£150 
£ 1 6 0 
2170 
£ 1 3 0 
£ 1 9 0 
££0  0 

££4  0 
2250 
£26  0 
££70 
£23  0 
££30 
£3  0 0 
231  0 

233  0 


1 


1 1 
1 0 

13 


5 0 


1 


DO  1 J=2,N 

I F < X < J > . L T . X M I N . X M I N = X < J > 

IF  < X '■  J > . G T . X M FI X > X M A X = X < J > 

CDNTIMUE 

RETURN 

END 

S UBROUTINE  P S C L < J , X M I N * S C fl L X , Y M Fl X » R . X S r. L » V SC L 
D I MENS  I ON  XSCL <6 1 > , YSCL  C£ 1 > 

GO  TO  <5  , 6>  , .J 
SCRLX=  <XMAX-XM  I N>  -'6  0 . 

SCALY= < YMAX-YM I N> /£ 0 . 

R-.  5 ►SCALY 
DO  1 U 1=1,61 
R I = I - 1 

XSCL  < I > =XM I N+fl I ♦SCFl LX 

I F < I -2 1 > 1 1 , 1 1 > 1 0 

YSCL  < I > =YM I N + (2 0 . -fl I > ♦SCALY 

CONTINUE 

PRINT  1.3  , 

FORMAT  <>v.O 
RETURN 

P R I N T 5*  u , X & CL*;  I.)  , I = 1 * 6 1 * 1 0 '> 

FORMAT  <F 1 1 . £ » 6F 1 0 . £> 

RETURN 

END 

SUBROUT  I ME  GZRO  (K  , I L I NE> 

D I MENS ION  I L I NE  <6 1 > , I SYM  <3> 

DATA  ISYM  < 1 > , I SYM  <£>  , ISYM  <3>  , " . " , “ 

L=£ 

if  <:<-■  1,2,1 

L-l 

DO  2 1=1,61 
I LINE <I> =ISYM <L> 

CONT I NUE 
GO  TO  (5»8)>L 
DO  6>  I = 1 , 6 1 , 1 0 


, YM  I N , XMRX> 


£3  4 0 

o 

I L I NE  < I > = I SYM  03 > 

£35  0 

PRINT  11,1  LINE 

236  0 

1 1 

FORMAT  <6X  , ” . . " , 6 1 fll  , " . . “) 

£370 

c : 

RETURN 

2 J *3  0 

END 

£390 

S U B R D IJ  TINE  S K P T < N , K , X , Y , Y S C L , X 

£4  0 0 

D I MENS I ON  X < 1 > r Y < 1 > r I L INE  <6 1 > , 

£41  0 

DRTR  I BL  j <1 SYM < I > ,1  = 1, 6> ✓ " “ , " 

£42  0 

DO  5 1=1, N 

c!  4 3 0 

I F <Y  •;  I !>  - YSCL  ao  — R j £,2,5 

2440 

2 

I F < Y C I > -YSCL <K> +R>  5,5,4 

£45  0 

4 

M= (X <D -XM I N > ySCALX+l - 5 

£46  0 

I F <N>  5,5,7 

MINrSCAL 
YSCL  <2 1 > 
♦" , "£", “ 


X * ILINE,L, R> 

, I SYM  6 ’> 

3" 9 "4" 9 " 5 " 9 Mc*v 
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2470 

r 

IF  <M-61>  6s»  6 ? 5 

243  0 

6 

I F < I L I NE  <M>  - 1 BL>  3 » 9 .»  3 

£49  0 

9 

I L I ME  <M>  = I SYM  <L> 

25  0 0 

SO  TO  5 

£510 

3 

ILINE<M>=ISYM<6> 

£520 

5 

CONTINUE 

£53  0 

RETURN 

£540 

END 

£550 

SUBROUT I NE  T YP I T <K r YSCL > ILI NE> 

£560 

D I MENS I ON  YSCL  <£ 1 > 1 1 L I NE <6 1 > 

£570 

JS=k+4 

£53  U 

I F <J3-JS/5*5}  6 0 !>  6 1 » 6 0 

£590 

61 

PR  I NT  3 .■>  YSCL  <K>  .-ILI NE 

£6  00 

FORMAT <F6.2» " + ", 1X»61A1> 1X» ”+IM> 

£610 

SO  TO  12 

2620 

so 

PRINT  16j ILINE 

£63  0 

16 

FORMAT  <6X »"-M»lX»61Al»lX»"-I"> 

£640 

12 

RETURN 

£650 

END 

ok 
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PROGRAM  SNOR2 

S 


□ LD : 3 NOR; 


OK 

LIST 

i 

3N0R2  15:44  CHI  CRT  1 1 4-'73 


1 0 O'BL  I B , L I NEQ , , , 

1 2 OIL  I B , XNORM , , , ♦♦♦ 
1 J U’l-L  I B , RANDX  , , , ♦♦♦ 


1 4 0 

DIMENSION  X<£1>  »R<21 

150 

DIMENSION  SC21>  ,P<21 

1 6 0 

DIMENSION  !.l  (5 0 ,21  > ,T 

1 9 0 

K=21 

2 1 0 

KK=K- 1 

£2  0 

N=5  0 

£3  0 

RN=N 

£4  0 

U=XNDRM (- 1 . > 

23  0 

CALL  OPENF <1  * "CORR") 

26  0 

RERD  Cl  -r  1 j CRV  C I > .-1  = 1 

£7  0 

1 

FORMAT C21F3. 2> 

£3  0 

READ  <1 , 1>  CSD  CI>  - 1 = 1 

£90 

DO  3 1=1 -K 

3 0 0 

READ  C 1 , 2>  CR  C I , J>  - ,J  = 

3 1 0 

C. 

FORMAT <2 1F3.2> 

3£  0 

3 

CONTINUE 

33  0 

DO  £5  1=1 ,K 

34  0 

T C I > = i j . 

35  0 

ESD C I > = 0 . 

36  0 

DO  30  J=1,K 

37  0 

P C I , J:>  = ij . 

330 

3 0 

CONTINUE 

39  0 

■— i cr 
C.  *» 

CONTINUE 

392 

DO  1000  1=1,50 

394 

U=XNORM < 0 . > 

39'S 

10  0 0 

CONTINUE 

4 ij  ij 

DO  5 1=1, N 

4 1 0 

I F C I -2 1 > 3 0 0 ,400,405 

42  U 

3 0 0 

LF  = 1 ' 

425 

GO  TO  305 

430 

4 1 j 0 

LF=2 

4 35 

DO  500  .1=1  , K 

440 

RV  C J>  =AV  C J>  -2 . 

1 > y SB  <£  1 > y Z C£  1 > y C C2  0 ? 
1 > y ESB  <2 1 > ,i  ER  < 2 1 y 2 1 > 


B cl  u .*•  !*  E \ £ ij  ].• 
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445 

5 0 0 

CONTINUE 

447 

50  TO  305 

450 

405 

I F < I - 4 1 > 3 0 5 ? 5 0 5 > 3 0 5 

455 

505 

LF=3 

457 

no  605  J=1,K 

458 

flV  CJ>  =flv  C J>  -£. 

45? 

6 u 3 

CONTINUE 

4 6 0 

305 

U=XNORM C 0 . > 

4 'i>5 

Z < 1 > =u 

470 

x ■:  i > =av  <:  i > +sd  < i > +z  < 1 :> 

48  0 

W C I ? 1 > =X  C 1> 

490 

T(1)=T(1)+Xa) 

5 0 0 

ESD  < 1 > =ESD  < 1 > +X  C 1 > *■!•<!  C 1 > 

310 

U=XNORM < 0 . > 

580 

Z (’£>  =R  < 1 ? £}  *Z  < 1 > +-IJ  ►SQRT  < 1 

53  0 

X C2>  =flV  C£>  +SD  <S>  +-Z  <£} 

54  0 

•j.I  1 ? cl.1  =X  C cl  j 

55  0 

T C£>  =T  <2>  +X  <2> 

36  0 

ESI'  C2>  =ESD  C2>  +X  <2>  •:'£> 

5?0 

no  6 J=3 .» K 

58  0 

J.I-J-1 

59  0 

no  7 L 1 - 1 ? JJ 

i~u!_l  |J 

no  3 L£= 1 t JJ 

6 1 0 

C L 1 j L£>  —R  (L 1 r L£) 

68  0 

CONTINUE 

63  0 

»** 

CONTINUE 

64  0 

DO  ? Ll  = l ? JJ 

65  0 

B CL  1 > =R  CL  1 , J> 

66  0 

E CL  1 > =B  CL  1 > 

67  0 

9 

CONT I NUE 

63  0 

CALL  LINEQ  <Cj  JJ.*  1 rKK> 

690 

RSQ= 0 . 

7 0 0 

H=  0 . 

71  0 

no  10  L 1 = 1 r • J J 

780 

H=H+B<L1>  ♦Z  CL  l) 

730 

RSQ-RSQ+B CL 1 > >E  CL  1 > 

74  0 

1 0 

CONT I NUE 

750 

U=XNORM < 0 . > 

7 6*  U 

Z <J>  =H  HI  ♦SORT  Cl . -RSQ> 

77  0 

X C J>  =ftv  < J>  +SD  < J>  +Z  C J> 

73  0 

l.i.l  C I j J>  =x  C J> 

79  0 

T CJ.)  =T  C J>  +X  C J> 

3 0 0 

ESD  C J>  =ESD  C J>  +X  CJ>  ♦X  CJ> 

3 1 0 

s 

CONTINUE 

38  0 

no  66  L=1 t K 

330 

no  67  J=1*K 

34  0 

p- CL?  J>  -P  CL  t J>  +X  CL>  ♦x  c j:> 

C 1 j d.-1  >R  1 >>  £..■  > 
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'L 


850 

■j  r 

CONTINUE 

36  0 

6 

CONTINUE 

865 

•MR ITE  L2,  1 u 0>  CM  L I , J>  , J-l  , K> 

3 6 7 

1 Ij  0 

FORMftT  <7F3.S> 

3 6 3 

WRITE  L2, 1 05>  LF 

y 6 y 

1 05 

FORMAT  Cl 1> 

37  0 

o 

CONTINUE 

875 

CALL  CLOSEF  <2 , “ RSCORE  " > 

33  0 

DO  70  1=1 »K 

39  0 

EM(I)=Ta.)/fiH 

9 0 0 

V 1=  LAN ♦ESD  LI > -T  L I > ♦T  L I > > LAN ♦•  LAN  - 1 . > > 

9 1 0 

ESD L I > =SQRT <VI> 

92  o 

DO  71  J = 1 :r  I 

93  0 

Q I J = LAN  ♦P  L 1 , J>  -T  LI  > ♦T  LJ>  > / LAN  ♦»  LAN  - 1 . > > 

9 4 0 

ER  LI  j .J>  =Q I J,'  LESD  LI>  ♦•ESD  LJ>  > 

95  0 

ER  L J, I > =ER  ( I , J> 

96  0 

71 

CONTINUE 

97  0 

7 0 

CONT I NUE 

93  0 

PRINT  SO, 

9 9 0 

3 0 

FORMAT  L5X, "SAMPLE  MEANS  AND  STAND. DEV. 

1 0 0 0 

M R I T E L 4 , 8 5 > L E M L I - 1 = 1,  K > 

1 0 1 0 

MR  ITE  L4, 85>  LESD  L 15  , 1 = 1,  K 5 

1 02  0 

35 

FORMAT L5X,7F6. 3) 

1 035 

CALL  CLOSEF  L4, " S M N S " > 

1 0 3 0 

PRINT  90, 

1 0 4 0 

9 0 

FORMAT  <■'-■■■- , 5X  , " CORRELAT I ONS  MATR I X " , ,-v 

1 05  0 

DO  91  I = 1 , K 

1 06  0 

MR  ITE  L3 , 925  (.ER  LI , J5  , J=  1 , K5 

1 07  0 

92 

-ORMflT  L8F 1 0. 7> 

1 03  0 

9 1 

CONTINUE 

1 035 

CALL  CLOSEF  L3 , " MATR I X M > 

1 090 

END 

□K 
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To  cope  with  the  expanding  technology,  our  society  must 
be  assured  of  a continuing  supply  of  rigorously  trained 
..  a*  and  educated  engineers.  The  School  of  Engineering  and 
Applied  Science  is  completely  committed  to  this  ob- 
jective. 


